Sep 16 12:47:56.828123 ip-10-0-137-26 systemd[1]: Starting Kubernetes Kubelet... Sep 16 12:47:57.221373 ip-10-0-137-26 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 12:47:57.221373 ip-10-0-137-26 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 16 12:47:57.221373 ip-10-0-137-26 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 12:47:57.221373 ip-10-0-137-26 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 16 12:47:57.221373 ip-10-0-137-26 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 12:47:57.222044 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.221406 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 16 12:47:57.224338 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224322 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 12:47:57.224338 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224337 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224342 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224345 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224348 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224351 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224354 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224357 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224361 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224365 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224368 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224371 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224374 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224376 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224381 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224384 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224387 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224390 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224393 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224395 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 12:47:57.224396 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224402 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224405 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224408 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224411 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224414 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224416 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224420 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224423 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224425 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224428 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224431 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224434 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224436 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224439 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224441 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224444 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224446 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224449 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224451 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224454 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 12:47:57.224839 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224456 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224459 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224461 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224464 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224466 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224468 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224471 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224473 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224476 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224478 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224481 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224483 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224485 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224515 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224520 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224523 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224526 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224529 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224532 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224535 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 12:47:57.225329 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224537 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224540 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224543 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224546 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224548 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224551 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224554 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224556 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224559 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224561 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224564 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224567 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224569 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224572 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224577 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224581 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224584 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224586 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224589 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 12:47:57.225842 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224592 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224595 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224597 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224600 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224603 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224606 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224609 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224612 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224614 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224617 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224619 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224622 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224624 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224627 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224629 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224632 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224634 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224637 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224639 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 12:47:57.226310 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.224642 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225313 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225320 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225324 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225327 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225330 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225333 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225337 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225340 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225342 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225345 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225348 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225351 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225355 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225359 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225362 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225365 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225368 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225371 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 12:47:57.226774 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225375 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225378 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225381 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225384 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225386 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225389 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225392 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225394 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225397 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225399 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225402 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225405 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225409 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225412 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225415 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225417 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225420 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225423 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225426 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225428 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 12:47:57.227255 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225431 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225434 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225437 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225439 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225442 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225444 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225447 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225449 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225451 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225454 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225456 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225459 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225462 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225465 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225467 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225470 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225473 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225475 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225478 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225480 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 12:47:57.227733 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225483 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225485 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225488 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225490 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225493 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225495 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225498 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225500 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225503 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225505 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225508 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225511 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225513 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225516 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225518 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225524 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225527 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225530 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225532 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 12:47:57.228233 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225535 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225537 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225540 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225542 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225545 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225548 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225552 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225554 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225557 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225560 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225562 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225565 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225567 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225570 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225572 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225575 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225577 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225579 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225582 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225584 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 12:47:57.228692 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225587 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225589 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225962 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225968 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225971 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225973 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225976 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225979 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225982 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225985 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225987 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225990 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225993 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225995 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.225998 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226000 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226003 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226005 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226009 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226012 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 16 12:47:57.229189 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226014 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226017 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226020 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226022 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226025 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226028 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226030 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226033 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226035 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226038 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226041 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226043 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226046 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226048 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226051 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226053 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226056 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226058 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226061 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226064 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 12:47:57.229673 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226067 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226071 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226075 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226078 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226081 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226084 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226087 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226090 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226093 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226096 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226098 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226101 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226103 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226106 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226108 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226111 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226113 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226116 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226118 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 12:47:57.230196 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226121 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226123 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226125 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226128 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226131 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226134 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226137 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226140 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226142 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226145 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226148 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226150 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226152 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226155 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226158 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226160 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226163 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226165 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226167 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 12:47:57.230661 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226170 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226173 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226175 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226178 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226180 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226183 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226185 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226188 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226190 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226192 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226195 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226198 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226201 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226204 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226206 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226209 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226211 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226214 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226216 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226219 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 12:47:57.231141 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226221 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226227 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226231 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226296 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226334 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226341 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226346 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226350 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226354 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226357 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226361 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226365 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226368 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226372 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226375 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226378 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226381 2580 flags.go:64] FLAG: --cgroup-root="" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226384 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226387 2580 flags.go:64] FLAG: --client-ca-file="" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226390 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226392 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226397 2580 flags.go:64] FLAG: --cluster-domain="" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226399 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 16 12:47:57.231609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226402 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226405 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226416 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226420 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226423 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226426 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226429 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226432 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226435 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226438 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226443 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226445 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226449 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226452 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226455 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226458 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226461 2580 flags.go:64] FLAG: --enable-server="true" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226468 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226473 2580 flags.go:64] FLAG: --event-burst="100" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226476 2580 flags.go:64] FLAG: --event-qps="50" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226479 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226482 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226486 2580 flags.go:64] FLAG: --eviction-hard="" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226489 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 16 12:47:57.232162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226492 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226495 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226499 2580 flags.go:64] FLAG: --eviction-soft="" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226502 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226504 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226507 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226510 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226513 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226516 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226519 2580 flags.go:64] FLAG: --feature-gates="" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226522 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226525 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226528 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226531 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226534 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226537 2580 flags.go:64] FLAG: --help="false" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226541 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226544 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226548 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226551 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226554 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226558 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226561 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 16 12:47:57.232721 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226564 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226567 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226570 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226574 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226577 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226580 2580 flags.go:64] FLAG: --kube-reserved="" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226583 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226586 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226589 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226592 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226595 2580 flags.go:64] FLAG: --lock-file="" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226598 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226601 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226604 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226609 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226612 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226615 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226618 2580 flags.go:64] FLAG: --logging-format="text" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226621 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226624 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226627 2580 flags.go:64] FLAG: --manifest-url="" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226630 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226635 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226638 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226642 2580 flags.go:64] FLAG: --max-pods="110" Sep 16 12:47:57.233308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226645 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226648 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226652 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226656 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226659 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226662 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226665 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226672 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226675 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226678 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226681 2580 flags.go:64] FLAG: --pod-cidr="" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226684 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226690 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226693 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226696 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226699 2580 flags.go:64] FLAG: --port="10250" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226702 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226705 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b057924a0065f820" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226708 2580 flags.go:64] FLAG: --qos-reserved="" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226711 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226714 2580 flags.go:64] FLAG: --register-node="true" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226717 2580 flags.go:64] FLAG: --register-with-taints="" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226720 2580 flags.go:64] FLAG: --registry-burst="10" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226723 2580 flags.go:64] FLAG: --registry-qps="5" Sep 16 12:47:57.233975 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226726 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226728 2580 flags.go:64] FLAG: --reserved-memory="" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226732 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226735 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226738 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226741 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226744 2580 flags.go:64] FLAG: --runonce="false" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226747 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226750 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226753 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226758 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226761 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226764 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226767 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226770 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226773 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226776 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226779 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226781 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226785 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226788 2580 flags.go:64] FLAG: --system-cgroups="" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226791 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226798 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226801 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226804 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 16 12:47:57.234589 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226808 2580 flags.go:64] FLAG: --tls-min-version="" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226811 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226814 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226817 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226820 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226823 2580 flags.go:64] FLAG: --v="2" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226826 2580 flags.go:64] FLAG: --version="false" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226830 2580 flags.go:64] FLAG: --vmodule="" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226834 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.226837 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226974 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226979 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226982 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226985 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226988 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226991 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226994 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.226998 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227000 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227003 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227006 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 12:47:57.235206 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227008 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227013 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227017 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227021 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227024 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227028 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227031 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227034 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227039 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227042 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227045 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227048 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227050 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227053 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227056 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227059 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227062 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227065 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227067 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 12:47:57.235712 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227070 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227073 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227075 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227078 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227081 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227083 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227086 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227090 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227093 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227097 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227099 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227102 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227105 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227108 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227110 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227113 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227115 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227118 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227120 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227123 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 12:47:57.236190 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227126 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227130 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227133 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227135 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227138 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227141 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227143 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227146 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227148 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227151 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227153 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227156 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227158 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227161 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227164 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227166 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227169 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227171 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227174 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227176 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 12:47:57.236978 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227179 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227183 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227185 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227188 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227190 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227193 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227195 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227198 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227201 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227203 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227205 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227208 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227210 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227214 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227217 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227219 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227222 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227225 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227227 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227230 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 12:47:57.237571 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227233 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227235 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227238 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227240 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227243 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227245 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227248 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227250 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.227253 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.227808 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.234803 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.234817 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.235755 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.235762 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 16 12:47:57.238083 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235823 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235828 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235832 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235837 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235841 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235855 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235859 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235862 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235865 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235868 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235871 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235873 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235877 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235880 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235883 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235886 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235888 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235891 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 12:47:57.238528 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235896 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235914 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235917 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235920 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235923 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235926 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235929 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235932 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235935 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235938 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235941 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235945 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235949 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235952 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235956 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235958 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235961 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235964 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235966 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235969 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 12:47:57.239018 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235971 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235974 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235977 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235979 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235982 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235984 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235987 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235990 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235993 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235995 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.235998 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236000 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236003 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236005 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236008 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236010 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236013 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236016 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236018 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236021 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 12:47:57.239514 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236023 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236026 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236028 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236032 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236035 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236038 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236040 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236042 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236045 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236048 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236051 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236053 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236055 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236058 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236060 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236063 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236065 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236068 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236071 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236073 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 12:47:57.240010 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236076 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236079 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236081 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236084 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236086 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236089 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236091 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236094 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236096 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236099 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236101 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236104 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236106 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236109 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236111 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236114 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236117 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236119 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236122 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236124 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 12:47:57.240503 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.236127 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.236132 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237587 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237600 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237603 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237606 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237609 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237611 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237615 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237617 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237620 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237622 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237625 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237627 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237630 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 12:47:57.241024 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237632 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237635 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237638 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237641 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237643 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237646 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237649 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237652 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237655 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237657 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237660 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237662 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237665 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237668 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237671 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237674 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237676 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237679 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237681 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 12:47:57.241400 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237689 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237691 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237694 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237697 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237699 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237702 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237705 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237707 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237710 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237712 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237715 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237717 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237720 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237723 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237725 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237728 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237730 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237733 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237737 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 12:47:57.241930 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237741 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237746 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237748 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237751 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237753 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237756 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237759 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237762 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237764 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237767 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237770 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237772 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237777 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237780 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237783 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237786 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237789 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237792 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237795 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237798 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 12:47:57.242398 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237800 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237803 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237806 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237808 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237811 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237814 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237817 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237819 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237822 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237824 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237827 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237829 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237832 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237835 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237838 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237841 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237858 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237861 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237864 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237867 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 12:47:57.242909 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237870 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237872 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237875 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237878 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237880 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237884 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237888 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:57.237891 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.237896 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.238014 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.240132 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.241194 2580 server.go:1019] "Starting client certificate rotation" Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.241292 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 12:47:57.243412 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.241328 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 12:47:57.244007 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.243993 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 12:47:57.245090 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.245073 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 12:47:57.260164 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.260143 2580 log.go:25] "Validated CRI v1 runtime API" Sep 16 12:47:57.263560 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.263546 2580 log.go:25] "Validated CRI v1 image API" Sep 16 12:47:57.264351 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.264336 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 16 12:47:57.267416 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.267400 2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c8bbc174-a182-42ab-82dc-1baec458c271:/dev/nvme0n1p3 ce44bb7f-f87f-47d5-a416-602c6dab080b:/dev/nvme0n1p4] Sep 16 12:47:57.267458 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.267417 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 16 12:47:57.268072 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.268058 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 12:47:57.273214 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.273107 2580 manager.go:216] Machine: {Timestamp:2026-09-16 12:47:57.271635123 +0000 UTC m=+0.330144023 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108984 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dff27f1b1fe50a2121bbd89612070 SystemUUID:ec2dff27-f1b1-fe50-a212-1bbd89612070 BootID:eb56564e-eace-469b-acc3-45fbe53d6ece Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ed:8b:f0:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ed:8b:f0:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:da:05:8a:74:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 16 12:47:57.273214 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.273211 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 16 12:47:57.273318 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.273286 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 16 12:47:57.276243 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.276215 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 16 12:47:57.276363 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.276246 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 16 12:47:57.276884 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.276875 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 16 12:47:57.276922 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.276887 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 16 12:47:57.276922 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.276895 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 12:47:57.277488 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.277479 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 12:47:57.278451 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.278442 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 16 12:47:57.282005 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.281994 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 16 12:47:57.282204 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.282190 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 16 12:47:57.282315 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.282304 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 16 12:47:57.282361 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.282323 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 16 12:47:57.282361 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.282350 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 16 12:47:57.282459 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.282364 2580 kubelet.go:398] "Adding apiserver pod source" Sep 16 12:47:57.282459 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.282373 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 16 12:47:57.282704 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.282690 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 12:47:57.282775 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.282708 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 12:47:57.285691 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.285667 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 16 12:47:57.287856 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.287828 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 16 12:47:57.287914 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.287875 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 16 12:47:57.289372 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289348 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5pnx7" Sep 16 12:47:57.289452 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.289423 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 16 12:47:57.289452 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.289440 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 16 12:47:57.289669 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289655 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 16 12:47:57.289669 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289673 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289679 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289688 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289699 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289708 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289722 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289727 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289734 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289739 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289747 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 16 12:47:57.289759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.289752 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 16 12:47:57.290550 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.290540 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 16 12:47:57.290550 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.290550 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 16 12:47:57.292969 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.292949 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 16 12:47:57.294221 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.294208 2580 server.go:1268] "Started kubelet" Sep 16 12:47:57.294290 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.294264 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 16 12:47:57.294352 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.294274 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 16 12:47:57.294352 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.294332 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 16 12:47:57.295048 ip-10-0-137-26 systemd[1]: Started Kubernetes Kubelet. Sep 16 12:47:57.296133 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.295522 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 16 12:47:57.297302 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.296736 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 16 12:47:57.297302 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.296986 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5pnx7" Sep 16 12:47:57.299327 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.299308 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 16 12:47:57.301329 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.301315 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 16 12:47:57.301910 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.301896 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 16 12:47:57.302047 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.302017 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:57.302575 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302559 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 16 12:47:57.302575 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302562 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 16 12:47:57.302720 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302584 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 16 12:47:57.302720 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302625 2580 factory.go:55] Registering systemd factory Sep 16 12:47:57.302720 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302638 2580 factory.go:223] Registration of the systemd container factory successfully Sep 16 12:47:57.302720 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302688 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 16 12:47:57.302720 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302696 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 16 12:47:57.302980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302839 2580 factory.go:153] Registering CRI-O factory Sep 16 12:47:57.302980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302867 2580 factory.go:223] Registration of the crio container factory successfully Sep 16 12:47:57.302980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302922 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 16 12:47:57.302980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302943 2580 factory.go:103] Registering Raw factory Sep 16 12:47:57.302980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.302957 2580 manager.go:1196] Started watching for new ooms in manager Sep 16 12:47:57.303356 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.303342 2580 manager.go:349] Starting recovery of all containers Sep 16 12:47:57.304466 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.304443 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 16 12:47:57.304983 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.304960 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 16 12:47:57.305485 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.304571 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-26.ec2.internal.18d5cdf494587cb2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-26.ec2.internal,UID:ip-10-0-137-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-26.ec2.internal,},FirstTimestamp:2026-09-16 12:47:57.294181554 +0000 UTC m=+0.352690453,LastTimestamp:2026-09-16 12:47:57.294181554 +0000 UTC m=+0.352690453,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-26.ec2.internal,}" Sep 16 12:47:57.316009 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.315991 2580 manager.go:354] Recovery completed Sep 16 12:47:57.320295 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.320196 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 12:47:57.322159 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.322140 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory" Sep 16 12:47:57.322234 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.322170 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 12:47:57.322234 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.322183 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID" Sep 16 12:47:57.322780 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.322760 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 16 12:47:57.322780 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.322777 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 16 12:47:57.322941 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.322777 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 12:47:57.322941 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.322795 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 16 12:47:57.323591 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.323572 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory" Sep 16 12:47:57.323664 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.323605 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 12:47:57.323664 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.323621 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID" Sep 16 12:47:57.324176 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.324161 2580 policy_none.go:49] "None policy: Start" Sep 16 12:47:57.324176 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.324178 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 16 12:47:57.324276 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.324187 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 16 12:47:57.325305 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.325294 2580 policy_none.go:47] "Start" Sep 16 12:47:57.359461 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.359440 2580 manager.go:337] "Starting Device Plugin manager" Sep 16 12:47:57.364599 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.359474 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 16 12:47:57.364599 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.359486 2580 server.go:87] "Starting device plugin registration server" Sep 16 12:47:57.364599 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.359781 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 16 12:47:57.364599 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.359792 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 16 12:47:57.364599 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.359911 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 16 12:47:57.364599 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.359986 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 16 12:47:57.364599 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.359995 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 16 12:47:57.364599 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.360523 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 16 12:47:57.364599 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.360570 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:57.394880 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.394837 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 16 12:47:57.396025 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.396001 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 16 12:47:57.396108 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.396059 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 16 12:47:57.396108 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.396085 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 16 12:47:57.396213 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.396166 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 16 12:47:57.398548 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.398527 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 12:47:57.460900 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.460878 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 12:47:57.462788 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.462772 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory" Sep 16 12:47:57.462900 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.462805 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 12:47:57.462900 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.462819 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID" Sep 16 12:47:57.462900 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.462860 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.470841 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.470823 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.470926 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.470854 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-26.ec2.internal\": node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:57.485315 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.485247 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:57.497691 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.497674 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal"] Sep 16 12:47:57.497754 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.497728 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 12:47:57.498486 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.498469 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory" Sep 16 12:47:57.498550 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.498502 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 12:47:57.498550 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.498517 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID" Sep 16 12:47:57.499590 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.499578 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 12:47:57.499696 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.499681 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.499744 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.499716 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 12:47:57.500323 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.500308 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory" Sep 16 12:47:57.500413 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.500332 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 12:47:57.500413 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.500343 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID" Sep 16 12:47:57.500870 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.500841 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory" Sep 16 12:47:57.500929 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.500883 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 12:47:57.500929 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.500893 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID" Sep 16 12:47:57.502037 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.502021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.502115 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.502052 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 12:47:57.502702 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.502687 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientMemory" Sep 16 12:47:57.502784 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.502715 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 12:47:57.502784 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.502729 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeHasSufficientPID" Sep 16 12:47:57.504643 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.504627 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/295a4691ffa078866ad582e2ba05a024-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"295a4691ffa078866ad582e2ba05a024\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.504701 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.504651 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/295a4691ffa078866ad582e2ba05a024-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"295a4691ffa078866ad582e2ba05a024\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.504701 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.504667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e1f1f6b3289e99d53558e6c90bce9c0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-26.ec2.internal\" (UID: \"8e1f1f6b3289e99d53558e6c90bce9c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.523895 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.523876 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-26.ec2.internal\" not found" node="ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.527878 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.527863 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-26.ec2.internal\" not found" node="ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.586093 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.586069 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:57.604871 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.604840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/295a4691ffa078866ad582e2ba05a024-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"295a4691ffa078866ad582e2ba05a024\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.604949 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.604875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/295a4691ffa078866ad582e2ba05a024-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"295a4691ffa078866ad582e2ba05a024\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.604949 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.604896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e1f1f6b3289e99d53558e6c90bce9c0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-26.ec2.internal\" (UID: \"8e1f1f6b3289e99d53558e6c90bce9c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.604949 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.604934 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/295a4691ffa078866ad582e2ba05a024-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"295a4691ffa078866ad582e2ba05a024\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.605063 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.604944 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/295a4691ffa078866ad582e2ba05a024-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal\" (UID: \"295a4691ffa078866ad582e2ba05a024\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.605063 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.604940 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e1f1f6b3289e99d53558e6c90bce9c0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-26.ec2.internal\" (UID: \"8e1f1f6b3289e99d53558e6c90bce9c0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.686677 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.686655 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:57.787354 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.787301 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:57.826838 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.826817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.830596 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:57.830577 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" Sep 16 12:47:57.888278 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.888249 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:57.988823 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:57.988798 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:58.090000 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:58.089972 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:58.190934 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:58.190906 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:58.241448 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.241419 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 16 12:47:58.241917 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.241584 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 12:47:58.291251 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:58.291228 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:58.302436 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.302397 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 12:42:58 +0000 UTC" deadline="2028-02-10 13:11:39.63096024 +0000 UTC" Sep 16 12:47:58.302436 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.302430 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12288h23m41.328534049s" Sep 16 12:47:58.368951 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.368876 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 12:47:58.393103 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:58.393078 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:58.407055 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:58.407025 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1f1f6b3289e99d53558e6c90bce9c0.slice/crio-77bd4b06008a86b87c5f6d3b22aaa47c50c9ca29529b70e460b9bc82bd2732b6 WatchSource:0}: Error finding container 77bd4b06008a86b87c5f6d3b22aaa47c50c9ca29529b70e460b9bc82bd2732b6: Status 404 returned error can't find the container with id 77bd4b06008a86b87c5f6d3b22aaa47c50c9ca29529b70e460b9bc82bd2732b6 Sep 16 12:47:58.407378 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:47:58.407352 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295a4691ffa078866ad582e2ba05a024.slice/crio-c141cac317b18a4d1265523ebd6cf6e9ee60bc82ffb63d3a9d2576974a074e55 WatchSource:0}: Error finding container c141cac317b18a4d1265523ebd6cf6e9ee60bc82ffb63d3a9d2576974a074e55: Status 404 returned error can't find the container with id c141cac317b18a4d1265523ebd6cf6e9ee60bc82ffb63d3a9d2576974a074e55 Sep 16 12:47:58.413327 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.413310 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 12:47:58.494231 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:58.494199 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:58.600814 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:58.600772 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:58.708128 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:58.708050 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-26.ec2.internal\" not found" Sep 16 12:47:58.711998 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.711982 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 12:47:58.802686 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.802651 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" Sep 16 12:47:58.811935 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.811906 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 12:47:58.813061 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.813049 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" Sep 16 12:47:58.823702 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.823685 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 12:47:58.876403 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:58.876386 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 12:47:59.283441 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.283404 2580 apiserver.go:52] "Watching apiserver" Sep 16 12:47:59.288966 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.288941 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 16 12:47:59.290456 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.290423 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hrnfn","openshift-dns/node-resolver-ssrrq","openshift-multus/multus-additional-cni-plugins-tmjfb","openshift-network-diagnostics/network-check-target-qsbrp","openshift-network-operator/iptables-alerter-59nfp","openshift-ovn-kubernetes/ovnkube-node-k6ccb","kube-system/konnectivity-agent-tkbd4","kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p","openshift-cluster-node-tuning-operator/tuned-hpm2d","openshift-image-registry/node-ca-k942t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal","openshift-multus/multus-xvwcv","openshift-multus/network-metrics-daemon-ltwsm"] Sep 16 12:47:59.292321 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.292298 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:47:59.293636 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.293605 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.294455 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.294435 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wtwnh\"" Sep 16 12:47:59.294579 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.294451 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 16 12:47:59.294579 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.294436 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 16 12:47:59.295802 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.295777 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 16 12:47:59.296034 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.296015 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 16 12:47:59.296124 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.296057 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.296124 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.296099 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 16 12:47:59.296290 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.296266 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 16 12:47:59.296379 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.296297 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6qbgp\"" Sep 16 12:47:59.297151 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.297118 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:47:59.297249 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.297190 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:47:59.297742 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.297723 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 16 12:47:59.298039 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.298021 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rj655\"" Sep 16 12:47:59.298129 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.298106 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 16 12:47:59.298522 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.298500 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.299996 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.299945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.300937 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.300891 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 16 12:47:59.300937 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.300931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 16 12:47:59.301088 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.301056 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 16 12:47:59.301176 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.301154 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b49k8\"" Sep 16 12:47:59.301430 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.301399 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.301576 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.301559 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 16 12:47:59.301668 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.301643 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 16 12:47:59.304994 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.304423 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 16 12:47:59.304994 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.304757 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 16 12:47:59.305191 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.305144 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 16 12:47:59.305191 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.305150 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 16 12:47:59.305317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.305198 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 16 12:47:59.305392 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.305379 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9222l\"" Sep 16 12:47:59.305520 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.305502 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 16 12:47:59.306464 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.305540 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6tw7g\"" Sep 16 12:47:59.306565 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.305728 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 16 12:47:59.306642 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.305770 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 16 12:47:59.306714 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.305956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.306801 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.306774 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:47:59.308006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.307985 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.309752 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.309731 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.310015 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.309993 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 16 12:47:59.310253 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.310213 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 16 12:47:59.310514 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.310411 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zq9w2\"" Sep 16 12:47:59.311698 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.311527 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.311922 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.311900 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 16 12:47:59.312036 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.312017 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 16 12:47:59.312092 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.312047 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vxvw8\"" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313074 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.313144 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-system-cni-dir\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313281 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-log-socket\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313328 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313354 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-etc-openvswitch\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-hostroot\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-conf-dir\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v79n\" (UniqueName: \"kubernetes.io/projected/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-kube-api-access-7v79n\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wrz9\" (UniqueName: \"kubernetes.io/projected/c9fd2062-ecf7-4b58-8aa2-93688aea141e-kube-api-access-2wrz9\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6480cf31-d326-49b5-9689-94759091a386-system-cni-dir\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313510 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-var-lib-cni-bin\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313525 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64rr\" (UniqueName: \"kubernetes.io/projected/6480cf31-d326-49b5-9689-94759091a386-kube-api-access-s64rr\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-var-lib-kubelet\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.314264 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/515f7ab2-bbec-4379-9337-2cc15e319b3c-dbus\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313653 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-device-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-slash\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-run-netns\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-cni-dir\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-cnibin\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6480cf31-d326-49b5-9689-94759091a386-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313801 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wlh26\"" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9szt\" (UniqueName: \"kubernetes.io/projected/4b5af094-de84-470d-b07b-5be03e6277a6-kube-api-access-f9szt\") pod \"iptables-alerter-59nfp\" (UID: \"4b5af094-de84-470d-b07b-5be03e6277a6\") " pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313894 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313955 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.313892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6480cf31-d326-49b5-9689-94759091a386-cnibin\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-run-ovn\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-cni-bin\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314050 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-registration-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-node-log\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314107 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2216d776-a5c5-4488-8d66-cf721d1b3f5b-ovnkube-config\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-sys-fs\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.315317 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6480cf31-d326-49b5-9689-94759091a386-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314193 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-socket-dir-parent\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-run-openvswitch\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2216d776-a5c5-4488-8d66-cf721d1b3f5b-ovnkube-script-lib\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-etc-selinux\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314411 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-cni-binary-copy\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-var-lib-cni-multus\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-daemon-config\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-cni-netd\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b5af094-de84-470d-b07b-5be03e6277a6-host-slash\") pod \"iptables-alerter-59nfp\" (UID: \"4b5af094-de84-470d-b07b-5be03e6277a6\") " pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-run-multus-certs\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7e30602-572a-4f2c-8618-2890660a5f75-konnectivity-ca\") pod \"konnectivity-agent-tkbd4\" (UID: \"d7e30602-572a-4f2c-8618-2890660a5f75\") " pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2216d776-a5c5-4488-8d66-cf721d1b3f5b-ovn-node-metrics-cert\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314653 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6480cf31-d326-49b5-9689-94759091a386-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314688 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/515f7ab2-bbec-4379-9337-2cc15e319b3c-kubelet-config\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.316131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-run-systemd\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-etc-kubernetes\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314765 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2216d776-a5c5-4488-8d66-cf721d1b3f5b-env-overrides\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-socket-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-var-lib-openvswitch\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314839 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-run-k8s-cni-cncf-io\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-run-netns\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314945 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-kubelet\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-systemd-units\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr7vs\" (UniqueName: \"kubernetes.io/projected/2216d776-a5c5-4488-8d66-cf721d1b3f5b-kube-api-access-cr7vs\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.314999 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.315014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7e30602-572a-4f2c-8618-2890660a5f75-agent-certs\") pod \"konnectivity-agent-tkbd4\" (UID: \"d7e30602-572a-4f2c-8618-2890660a5f75\") " pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.315017 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.315038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.315061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6480cf31-d326-49b5-9689-94759091a386-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.316952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.315076 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b5af094-de84-470d-b07b-5be03e6277a6-iptables-alerter-script\") pod \"iptables-alerter-59nfp\" (UID: \"4b5af094-de84-470d-b07b-5be03e6277a6\") " pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.340273 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.340252 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v6wtb" Sep 16 12:47:59.349971 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.349946 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v6wtb" Sep 16 12:47:59.401443 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.401389 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" event={"ID":"295a4691ffa078866ad582e2ba05a024","Type":"ContainerStarted","Data":"c141cac317b18a4d1265523ebd6cf6e9ee60bc82ffb63d3a9d2576974a074e55"} Sep 16 12:47:59.402616 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.402591 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" event={"ID":"8e1f1f6b3289e99d53558e6c90bce9c0","Type":"ContainerStarted","Data":"77bd4b06008a86b87c5f6d3b22aaa47c50c9ca29529b70e460b9bc82bd2732b6"} Sep 16 12:47:59.404079 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.404054 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 16 12:47:59.415807 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.415772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/515f7ab2-bbec-4379-9337-2cc15e319b3c-kubelet-config\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.415996 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.415812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-modprobe-d\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.415996 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.415841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-run-systemd\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.415996 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.415911 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/515f7ab2-bbec-4379-9337-2cc15e319b3c-kubelet-config\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.415996 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.415945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-etc-kubernetes\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.415996 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.415975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2216d776-a5c5-4488-8d66-cf721d1b3f5b-env-overrides\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.415994 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-etc-kubernetes\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416003 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-socket-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.415977 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-run-systemd\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-var-lib-openvswitch\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416085 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-var-lib-openvswitch\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-run-k8s-cni-cncf-io\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416127 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-run-netns\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-run-k8s-cni-cncf-io\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-kubelet\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416162 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-socket-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416177 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-run-netns\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416184 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-systemd-units\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416212 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-kubelet\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416217 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9x9x\" (UniqueName: \"kubernetes.io/projected/a69a0931-4858-4609-85df-062a0d799e1a-kube-api-access-g9x9x\") pod \"node-resolver-ssrrq\" (UID: \"a69a0931-4858-4609-85df-062a0d799e1a\") " pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416231 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-systemd-units\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2964d87-4632-4930-a87c-0cafa4154548-serviceca\") pod \"node-ca-k942t\" (UID: \"f2964d87-4632-4930-a87c-0cafa4154548\") " pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.416303 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr7vs\" (UniqueName: \"kubernetes.io/projected/2216d776-a5c5-4488-8d66-cf721d1b3f5b-kube-api-access-cr7vs\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7e30602-572a-4f2c-8618-2890660a5f75-agent-certs\") pod \"konnectivity-agent-tkbd4\" (UID: \"d7e30602-572a-4f2c-8618-2890660a5f75\") " pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6480cf31-d326-49b5-9689-94759091a386-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416376 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b5af094-de84-470d-b07b-5be03e6277a6-iptables-alerter-script\") pod \"iptables-alerter-59nfp\" (UID: \"4b5af094-de84-470d-b07b-5be03e6277a6\") " pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-system-cni-dir\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416428 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-log-socket\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416472 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2216d776-a5c5-4488-8d66-cf721d1b3f5b-env-overrides\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416490 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-log-socket\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.416595 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.416677 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret podName:515f7ab2-bbec-4379-9337-2cc15e319b3c nodeName:}" failed. No retries permitted until 2026-09-16 12:47:59.91665258 +0000 UTC m=+2.975161487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret") pod "global-pull-secret-syncer-hrnfn" (UID: "515f7ab2-bbec-4379-9337-2cc15e319b3c") : object "kube-system"/"original-pull-secret" not registered Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416692 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6480cf31-d326-49b5-9689-94759091a386-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416826 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-system-cni-dir\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.417185 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416865 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78kzq\" (UniqueName: \"kubernetes.io/projected/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-kube-api-access-78kzq\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-etc-openvswitch\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-hostroot\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.416977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-conf-dir\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v79n\" (UniqueName: \"kubernetes.io/projected/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-kube-api-access-7v79n\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrz9\" (UniqueName: \"kubernetes.io/projected/c9fd2062-ecf7-4b58-8aa2-93688aea141e-kube-api-access-2wrz9\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6480cf31-d326-49b5-9689-94759091a386-system-cni-dir\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-tmp\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417112 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775wg\" (UniqueName: \"kubernetes.io/projected/f2964d87-4632-4930-a87c-0cafa4154548-kube-api-access-775wg\") pod \"node-ca-k942t\" (UID: \"f2964d87-4632-4930-a87c-0cafa4154548\") " pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417167 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-etc-openvswitch\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417213 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-var-lib-cni-bin\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-var-lib-cni-bin\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417310 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64rr\" (UniqueName: \"kubernetes.io/projected/6480cf31-d326-49b5-9689-94759091a386-kube-api-access-s64rr\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a69a0931-4858-4609-85df-062a0d799e1a-hosts-file\") pod \"node-resolver-ssrrq\" (UID: \"a69a0931-4858-4609-85df-062a0d799e1a\") " pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417359 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-conf-dir\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.418199 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-var-lib-kubelet\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417424 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/515f7ab2-bbec-4379-9337-2cc15e319b3c-dbus\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2964d87-4632-4930-a87c-0cafa4154548-host\") pod \"node-ca-k942t\" (UID: \"f2964d87-4632-4930-a87c-0cafa4154548\") " pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-device-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417502 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-slash\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6480cf31-d326-49b5-9689-94759091a386-system-cni-dir\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-run-netns\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417571 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-cni-dir\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-cnibin\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6480cf31-d326-49b5-9689-94759091a386-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417646 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/515f7ab2-bbec-4379-9337-2cc15e319b3c-dbus\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417716 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-device-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417714 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-var-lib-kubelet\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417739 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-cni-dir\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-slash\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9szt\" (UniqueName: \"kubernetes.io/projected/4b5af094-de84-470d-b07b-5be03e6277a6-kube-api-access-f9szt\") pod \"iptables-alerter-59nfp\" (UID: \"4b5af094-de84-470d-b07b-5be03e6277a6\") " pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.419166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-kubernetes\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417805 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-run-netns\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417800 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-cnibin\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6480cf31-d326-49b5-9689-94759091a386-cnibin\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-run-ovn\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418006 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b5af094-de84-470d-b07b-5be03e6277a6-iptables-alerter-script\") pod \"iptables-alerter-59nfp\" (UID: \"4b5af094-de84-470d-b07b-5be03e6277a6\") " pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-cni-bin\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418070 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6480cf31-d326-49b5-9689-94759091a386-cnibin\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-registration-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-run\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418125 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-cni-bin\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-registration-dir\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.417117 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-hostroot\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-sys\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418167 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-run-ovn\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418192 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-lib-modules\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-host\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-node-log\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420006 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2216d776-a5c5-4488-8d66-cf721d1b3f5b-ovnkube-config\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-sys-fs\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6480cf31-d326-49b5-9689-94759091a386-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6480cf31-d326-49b5-9689-94759091a386-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418381 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a69a0931-4858-4609-85df-062a0d799e1a-tmp-dir\") pod \"node-resolver-ssrrq\" (UID: \"a69a0931-4858-4609-85df-062a0d799e1a\") " pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-tuned\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j4kk\" (UniqueName: \"kubernetes.io/projected/41775133-5324-474c-9c12-645b149e7113-kube-api-access-9j4kk\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-socket-dir-parent\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-run-openvswitch\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2216d776-a5c5-4488-8d66-cf721d1b3f5b-ovnkube-script-lib\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-etc-selinux\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-sysctl-conf\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-cni-binary-copy\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-var-lib-cni-multus\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-daemon-config\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-cni-netd\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.420980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b5af094-de84-470d-b07b-5be03e6277a6-host-slash\") pod \"iptables-alerter-59nfp\" (UID: \"4b5af094-de84-470d-b07b-5be03e6277a6\") " pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-sysctl-d\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-run-multus-certs\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7e30602-572a-4f2c-8618-2890660a5f75-konnectivity-ca\") pod \"konnectivity-agent-tkbd4\" (UID: \"d7e30602-572a-4f2c-8618-2890660a5f75\") " pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418753 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-sysconfig\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2216d776-a5c5-4488-8d66-cf721d1b3f5b-ovn-node-metrics-cert\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6480cf31-d326-49b5-9689-94759091a386-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418806 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2216d776-a5c5-4488-8d66-cf721d1b3f5b-ovnkube-config\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-systemd\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418837 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6480cf31-d326-49b5-9689-94759091a386-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418307 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-node-log\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418865 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-var-lib-kubelet\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418932 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-run-openvswitch\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.418990 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b5af094-de84-470d-b07b-5be03e6277a6-host-slash\") pod \"iptables-alerter-59nfp\" (UID: \"4b5af094-de84-470d-b07b-5be03e6277a6\") " pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419044 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-socket-dir-parent\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419150 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-etc-selinux\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419351 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9fd2062-ecf7-4b58-8aa2-93688aea141e-sys-fs\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.421815 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419415 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2216d776-a5c5-4488-8d66-cf721d1b3f5b-ovnkube-script-lib\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419473 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-var-lib-cni-multus\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419504 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7e30602-572a-4f2c-8618-2890660a5f75-konnectivity-ca\") pod \"konnectivity-agent-tkbd4\" (UID: \"d7e30602-572a-4f2c-8618-2890660a5f75\") " pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419516 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419530 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-multus-daemon-config\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419566 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2216d776-a5c5-4488-8d66-cf721d1b3f5b-host-cni-netd\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-host-run-multus-certs\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.419669 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-cni-binary-copy\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.420005 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6480cf31-d326-49b5-9689-94759091a386-cni-binary-copy\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.422646 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2216d776-a5c5-4488-8d66-cf721d1b3f5b-ovn-node-metrics-cert\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.422819 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.422655 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7e30602-572a-4f2c-8618-2890660a5f75-agent-certs\") pod \"konnectivity-agent-tkbd4\" (UID: \"d7e30602-572a-4f2c-8618-2890660a5f75\") " pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:47:59.434577 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.434549 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v79n\" (UniqueName: \"kubernetes.io/projected/9c9ad48b-5f4c-4a69-bb79-5a1af5918a10-kube-api-access-7v79n\") pod \"multus-xvwcv\" (UID: \"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10\") " pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.435385 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.435362 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 12:47:59.435385 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.435388 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 12:47:59.435559 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.435403 2580 projected.go:196] Error preparing data for projected volume kube-api-access-psn9c for pod openshift-network-diagnostics/network-check-target-qsbrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:47:59.435559 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.435483 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c podName:5d997e5a-fd8b-49a0-8264-12e773951182 nodeName:}" failed. No retries permitted until 2026-09-16 12:47:59.935462031 +0000 UTC m=+2.993970924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-psn9c" (UniqueName: "kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c") pod "network-check-target-qsbrp" (UID: "5d997e5a-fd8b-49a0-8264-12e773951182") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:47:59.439024 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.438996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wrz9\" (UniqueName: \"kubernetes.io/projected/c9fd2062-ecf7-4b58-8aa2-93688aea141e-kube-api-access-2wrz9\") pod \"aws-ebs-csi-driver-node-7c94p\" (UID: \"c9fd2062-ecf7-4b58-8aa2-93688aea141e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.439976 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.439955 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9szt\" (UniqueName: \"kubernetes.io/projected/4b5af094-de84-470d-b07b-5be03e6277a6-kube-api-access-f9szt\") pod \"iptables-alerter-59nfp\" (UID: \"4b5af094-de84-470d-b07b-5be03e6277a6\") " pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.440315 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.440284 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64rr\" (UniqueName: \"kubernetes.io/projected/6480cf31-d326-49b5-9689-94759091a386-kube-api-access-s64rr\") pod \"multus-additional-cni-plugins-tmjfb\" (UID: \"6480cf31-d326-49b5-9689-94759091a386\") " pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.440408 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.440335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr7vs\" (UniqueName: \"kubernetes.io/projected/2216d776-a5c5-4488-8d66-cf721d1b3f5b-kube-api-access-cr7vs\") pod \"ovnkube-node-k6ccb\" (UID: \"2216d776-a5c5-4488-8d66-cf721d1b3f5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.519656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-systemd\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.519656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519657 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-var-lib-kubelet\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.519957 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-modprobe-d\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.519957 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9x9x\" (UniqueName: \"kubernetes.io/projected/a69a0931-4858-4609-85df-062a0d799e1a-kube-api-access-g9x9x\") pod \"node-resolver-ssrrq\" (UID: \"a69a0931-4858-4609-85df-062a0d799e1a\") " pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.519957 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519724 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2964d87-4632-4930-a87c-0cafa4154548-serviceca\") pod \"node-ca-k942t\" (UID: \"f2964d87-4632-4930-a87c-0cafa4154548\") " pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.519957 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519771 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-systemd\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.519957 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-var-lib-kubelet\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.519957 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519908 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-modprobe-d\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.519957 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78kzq\" (UniqueName: \"kubernetes.io/projected/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-kube-api-access-78kzq\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.519957 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-tmp\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.519974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-775wg\" (UniqueName: \"kubernetes.io/projected/f2964d87-4632-4930-a87c-0cafa4154548-kube-api-access-775wg\") pod \"node-ca-k942t\" (UID: \"f2964d87-4632-4930-a87c-0cafa4154548\") " pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a69a0931-4858-4609-85df-062a0d799e1a-hosts-file\") pod \"node-resolver-ssrrq\" (UID: \"a69a0931-4858-4609-85df-062a0d799e1a\") " pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520034 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2964d87-4632-4930-a87c-0cafa4154548-host\") pod \"node-ca-k942t\" (UID: \"f2964d87-4632-4930-a87c-0cafa4154548\") " pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-kubernetes\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-run\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-sys\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-lib-modules\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-host\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a69a0931-4858-4609-85df-062a0d799e1a-tmp-dir\") pod \"node-resolver-ssrrq\" (UID: \"a69a0931-4858-4609-85df-062a0d799e1a\") " pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-tuned\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520210 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2964d87-4632-4930-a87c-0cafa4154548-host\") pod \"node-ca-k942t\" (UID: \"f2964d87-4632-4930-a87c-0cafa4154548\") " pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j4kk\" (UniqueName: \"kubernetes.io/projected/41775133-5324-474c-9c12-645b149e7113-kube-api-access-9j4kk\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-sysctl-conf\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520323 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2964d87-4632-4930-a87c-0cafa4154548-serviceca\") pod \"node-ca-k942t\" (UID: \"f2964d87-4632-4930-a87c-0cafa4154548\") " pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520323 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-sysctl-d\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.520387 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-sysconfig\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520415 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-kubernetes\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520437 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-sysconfig\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520486 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-host\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520455 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-run\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520467 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-sysctl-d\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520607 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-lib-modules\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520662 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-sys\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520772 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a69a0931-4858-4609-85df-062a0d799e1a-tmp-dir\") pod \"node-resolver-ssrrq\" (UID: \"a69a0931-4858-4609-85df-062a0d799e1a\") " pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.520868 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a69a0931-4858-4609-85df-062a0d799e1a-hosts-file\") pod \"node-resolver-ssrrq\" (UID: \"a69a0931-4858-4609-85df-062a0d799e1a\") " pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.520897 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.520966 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs podName:41775133-5324-474c-9c12-645b149e7113 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:00.020950086 +0000 UTC m=+3.079458975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs") pod "network-metrics-daemon-ltwsm" (UID: "41775133-5324-474c-9c12-645b149e7113") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:47:59.521269 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.521191 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-sysctl-conf\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.523775 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.523428 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-etc-tuned\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.523775 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.523566 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-tmp\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.547134 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.547063 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j4kk\" (UniqueName: \"kubernetes.io/projected/41775133-5324-474c-9c12-645b149e7113-kube-api-access-9j4kk\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:47:59.555416 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.555384 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78kzq\" (UniqueName: \"kubernetes.io/projected/cbf8c1e2-c807-4d5c-90d5-aa46a1020650-kube-api-access-78kzq\") pod \"tuned-hpm2d\" (UID: \"cbf8c1e2-c807-4d5c-90d5-aa46a1020650\") " pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.559582 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.559546 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9x9x\" (UniqueName: \"kubernetes.io/projected/a69a0931-4858-4609-85df-062a0d799e1a-kube-api-access-g9x9x\") pod \"node-resolver-ssrrq\" (UID: \"a69a0931-4858-4609-85df-062a0d799e1a\") " pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.559733 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.559629 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-775wg\" (UniqueName: \"kubernetes.io/projected/f2964d87-4632-4930-a87c-0cafa4154548-kube-api-access-775wg\") pod \"node-ca-k942t\" (UID: \"f2964d87-4632-4930-a87c-0cafa4154548\") " pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.607224 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.607183 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:47:59.615310 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.615281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xvwcv" Sep 16 12:47:59.626035 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.626002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" Sep 16 12:47:59.632394 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.632371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-59nfp" Sep 16 12:47:59.639525 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.639497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:47:59.647515 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.647491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" Sep 16 12:47:59.654637 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.654604 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ssrrq" Sep 16 12:47:59.661659 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.661631 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" Sep 16 12:47:59.667699 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.667677 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k942t" Sep 16 12:47:59.801117 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.801034 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 12:47:59.923348 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:47:59.923299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:47:59.923523 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.923488 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 12:47:59.923594 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:47:59.923579 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret podName:515f7ab2-bbec-4379-9337-2cc15e319b3c nodeName:}" failed. No retries permitted until 2026-09-16 12:48:00.923555025 +0000 UTC m=+3.982063918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret") pod "global-pull-secret-syncer-hrnfn" (UID: "515f7ab2-bbec-4379-9337-2cc15e319b3c") : object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:00.024394 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:00.024351 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:00.024566 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:00.024401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:00.024566 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:00.024515 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 12:48:00.024566 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:00.024547 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 12:48:00.024566 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:00.024561 2580 projected.go:196] Error preparing data for projected volume kube-api-access-psn9c for pod openshift-network-diagnostics/network-check-target-qsbrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:00.024750 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:00.024613 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c podName:5d997e5a-fd8b-49a0-8264-12e773951182 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:01.024594895 +0000 UTC m=+4.083103788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-psn9c" (UniqueName: "kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c") pod "network-check-target-qsbrp" (UID: "5d997e5a-fd8b-49a0-8264-12e773951182") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:00.024750 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:00.024519 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:00.024750 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:00.024725 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs podName:41775133-5324-474c-9c12-645b149e7113 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:01.024697112 +0000 UTC m=+4.083206006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs") pod "network-metrics-daemon-ltwsm" (UID: "41775133-5324-474c-9c12-645b149e7113") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:00.352191 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:00.352146 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 12:43:00 +0000 UTC" deadline="2028-07-01 22:39:45.78603498 +0000 UTC" Sep 16 12:48:00.352191 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:00.352185 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15705h51m45.433854495s" Sep 16 12:48:00.396895 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:00.396841 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:00.397102 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:00.396995 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:00.519415 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:48:00.519020 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e30602_572a_4f2c_8618_2890660a5f75.slice/crio-1d82ca5d6731c5473eb043537a632cafa81b1282a9c6110603cd3194530ac874 WatchSource:0}: Error finding container 1d82ca5d6731c5473eb043537a632cafa81b1282a9c6110603cd3194530ac874: Status 404 returned error can't find the container with id 1d82ca5d6731c5473eb043537a632cafa81b1282a9c6110603cd3194530ac874 Sep 16 12:48:00.520430 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:48:00.520343 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf8c1e2_c807_4d5c_90d5_aa46a1020650.slice/crio-29c93d0fdcf90053118d66288344edc4ff91687ea7c849ff47d73d3b278d47d3 WatchSource:0}: Error finding container 29c93d0fdcf90053118d66288344edc4ff91687ea7c849ff47d73d3b278d47d3: Status 404 returned error can't find the container with id 29c93d0fdcf90053118d66288344edc4ff91687ea7c849ff47d73d3b278d47d3 Sep 16 12:48:00.522427 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:48:00.522163 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9ad48b_5f4c_4a69_bb79_5a1af5918a10.slice/crio-df740c19cdb344e996975385073471d61a2d861eb1be096158faf876d92275aa WatchSource:0}: Error finding container df740c19cdb344e996975385073471d61a2d861eb1be096158faf876d92275aa: Status 404 returned error can't find the container with id df740c19cdb344e996975385073471d61a2d861eb1be096158faf876d92275aa Sep 16 12:48:00.525108 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:48:00.525085 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6480cf31_d326_49b5_9689_94759091a386.slice/crio-c4be1ea9477332f2bedec2ec176a4560cab263a16d56b0d396b4e6cf29e2d811 WatchSource:0}: Error finding container c4be1ea9477332f2bedec2ec176a4560cab263a16d56b0d396b4e6cf29e2d811: Status 404 returned error can't find the container with id c4be1ea9477332f2bedec2ec176a4560cab263a16d56b0d396b4e6cf29e2d811 Sep 16 12:48:00.527941 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:48:00.527892 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69a0931_4858_4609_85df_062a0d799e1a.slice/crio-c9e9e388e6f264282306f3abf7a083aa2ab7a25012a2c92bcaabc99fae55834e WatchSource:0}: Error finding container c9e9e388e6f264282306f3abf7a083aa2ab7a25012a2c92bcaabc99fae55834e: Status 404 returned error can't find the container with id c9e9e388e6f264282306f3abf7a083aa2ab7a25012a2c92bcaabc99fae55834e Sep 16 12:48:00.530775 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:48:00.529912 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9fd2062_ecf7_4b58_8aa2_93688aea141e.slice/crio-7f45a4f727e05c771f9f4e4cbd92ab1af3d262dd460af3809d8fdaa846ade3e6 WatchSource:0}: Error finding container 7f45a4f727e05c771f9f4e4cbd92ab1af3d262dd460af3809d8fdaa846ade3e6: Status 404 returned error can't find the container with id 7f45a4f727e05c771f9f4e4cbd92ab1af3d262dd460af3809d8fdaa846ade3e6 Sep 16 12:48:00.933040 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:00.932943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:00.933207 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:00.933139 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:00.933267 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:00.933232 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret podName:515f7ab2-bbec-4379-9337-2cc15e319b3c nodeName:}" failed. No retries permitted until 2026-09-16 12:48:02.933205802 +0000 UTC m=+5.991714708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret") pod "global-pull-secret-syncer-hrnfn" (UID: "515f7ab2-bbec-4379-9337-2cc15e319b3c") : object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:01.033667 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.033622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:01.033853 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.033686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:01.033943 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:01.033900 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:01.034012 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:01.033974 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs podName:41775133-5324-474c-9c12-645b149e7113 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:03.033952956 +0000 UTC m=+6.092461848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs") pod "network-metrics-daemon-ltwsm" (UID: "41775133-5324-474c-9c12-645b149e7113") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:01.034594 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:01.034427 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 12:48:01.034594 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:01.034454 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 12:48:01.034594 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:01.034469 2580 projected.go:196] Error preparing data for projected volume kube-api-access-psn9c for pod openshift-network-diagnostics/network-check-target-qsbrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:01.034594 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:01.034531 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c podName:5d997e5a-fd8b-49a0-8264-12e773951182 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:03.034511597 +0000 UTC m=+6.093020495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-psn9c" (UniqueName: "kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c") pod "network-check-target-qsbrp" (UID: "5d997e5a-fd8b-49a0-8264-12e773951182") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:01.353248 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.353123 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 12:43:00 +0000 UTC" deadline="2028-04-02 23:45:02.707253475 +0000 UTC" Sep 16 12:48:01.353248 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.353193 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13546h57m1.354065689s" Sep 16 12:48:01.408838 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.408573 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:01.408838 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:01.408694 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:01.409130 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.409105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:01.409268 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:01.409221 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:01.409333 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.409299 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:01.409411 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:01.409388 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:01.418154 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.418083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-59nfp" event={"ID":"4b5af094-de84-470d-b07b-5be03e6277a6","Type":"ContainerStarted","Data":"a541b9f3a81b3bf8f13005d8b555ba944a9e42c79fd36eeb8928e3f6b73e81ec"} Sep 16 12:48:01.429355 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.429313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k942t" event={"ID":"f2964d87-4632-4930-a87c-0cafa4154548","Type":"ContainerStarted","Data":"8ba3740e7ed4560b02900da194733668f036f3089c07913e0c06fa8d95c57b81"} Sep 16 12:48:01.438118 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.438085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xvwcv" event={"ID":"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10","Type":"ContainerStarted","Data":"df740c19cdb344e996975385073471d61a2d861eb1be096158faf876d92275aa"} Sep 16 12:48:01.442538 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.442502 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" event={"ID":"cbf8c1e2-c807-4d5c-90d5-aa46a1020650","Type":"ContainerStarted","Data":"29c93d0fdcf90053118d66288344edc4ff91687ea7c849ff47d73d3b278d47d3"} Sep 16 12:48:01.448093 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.447509 2580 generic.go:356] "Generic (PLEG): container finished" podID="295a4691ffa078866ad582e2ba05a024" containerID="7d43881a5b6759d25719284e3debfd5c1f4e8d333e3a66b6a1e9dee0a1dfca88" exitCode=0 Sep 16 12:48:01.448093 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.447607 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" event={"ID":"295a4691ffa078866ad582e2ba05a024","Type":"ContainerDied","Data":"7d43881a5b6759d25719284e3debfd5c1f4e8d333e3a66b6a1e9dee0a1dfca88"} Sep 16 12:48:01.450539 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.450399 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" event={"ID":"c9fd2062-ecf7-4b58-8aa2-93688aea141e","Type":"ContainerStarted","Data":"7f45a4f727e05c771f9f4e4cbd92ab1af3d262dd460af3809d8fdaa846ade3e6"} Sep 16 12:48:01.453947 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.453861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ssrrq" event={"ID":"a69a0931-4858-4609-85df-062a0d799e1a","Type":"ContainerStarted","Data":"c9e9e388e6f264282306f3abf7a083aa2ab7a25012a2c92bcaabc99fae55834e"} Sep 16 12:48:01.460558 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.460482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" event={"ID":"6480cf31-d326-49b5-9689-94759091a386","Type":"ContainerStarted","Data":"c4be1ea9477332f2bedec2ec176a4560cab263a16d56b0d396b4e6cf29e2d811"} Sep 16 12:48:01.480899 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.480635 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tkbd4" event={"ID":"d7e30602-572a-4f2c-8618-2890660a5f75","Type":"ContainerStarted","Data":"1d82ca5d6731c5473eb043537a632cafa81b1282a9c6110603cd3194530ac874"} Sep 16 12:48:01.499268 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.499199 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" event={"ID":"8e1f1f6b3289e99d53558e6c90bce9c0","Type":"ContainerStarted","Data":"ee224d284ef39855261774524394d0cea769ab961bbf01d052f6b8af03bbf2f5"} Sep 16 12:48:01.511509 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:01.511404 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" event={"ID":"2216d776-a5c5-4488-8d66-cf721d1b3f5b","Type":"ContainerStarted","Data":"107f896d56957713feb75c0c7ca9a335a2d40841511a307cab001ebea9f278f0"} Sep 16 12:48:02.561741 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:02.561507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" event={"ID":"295a4691ffa078866ad582e2ba05a024","Type":"ContainerStarted","Data":"deb75ff6c79666f1e13b20e0352cff5e184d1adffa74213ea8832467350e32ed"} Sep 16 12:48:02.580961 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:02.579479 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-26.ec2.internal" podStartSLOduration=3.579457554 podStartE2EDuration="3.579457554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:01.526935602 +0000 UTC m=+4.585444514" watchObservedRunningTime="2026-09-16 12:48:02.579457554 +0000 UTC m=+5.637966484" Sep 16 12:48:02.953674 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:02.953621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:02.954476 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:02.953932 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:02.954476 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:02.954012 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret podName:515f7ab2-bbec-4379-9337-2cc15e319b3c nodeName:}" failed. No retries permitted until 2026-09-16 12:48:06.953989411 +0000 UTC m=+10.012498317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret") pod "global-pull-secret-syncer-hrnfn" (UID: "515f7ab2-bbec-4379-9337-2cc15e319b3c") : object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:03.055276 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:03.054336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:03.055276 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:03.054393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:03.055276 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:03.054603 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:03.055276 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:03.054676 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs podName:41775133-5324-474c-9c12-645b149e7113 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:07.054653385 +0000 UTC m=+10.113162293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs") pod "network-metrics-daemon-ltwsm" (UID: "41775133-5324-474c-9c12-645b149e7113") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:03.055276 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:03.055144 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 12:48:03.055276 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:03.055169 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 12:48:03.055276 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:03.055184 2580 projected.go:196] Error preparing data for projected volume kube-api-access-psn9c for pod openshift-network-diagnostics/network-check-target-qsbrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:03.055276 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:03.055234 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c podName:5d997e5a-fd8b-49a0-8264-12e773951182 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:07.055216775 +0000 UTC m=+10.113725668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-psn9c" (UniqueName: "kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c") pod "network-check-target-qsbrp" (UID: "5d997e5a-fd8b-49a0-8264-12e773951182") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:03.396789 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:03.396696 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:03.396987 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:03.396861 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:03.397312 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:03.397286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:03.397438 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:03.397389 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:03.397522 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:03.397462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:03.397579 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:03.397534 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:05.397278 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:05.397064 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:05.397278 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:05.397239 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:05.397839 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:05.397686 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:05.397839 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:05.397787 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:05.397968 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:05.397842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:05.397968 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:05.397951 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:06.991577 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:06.991525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:06.992107 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:06.991707 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:06.992107 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:06.991806 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret podName:515f7ab2-bbec-4379-9337-2cc15e319b3c nodeName:}" failed. No retries permitted until 2026-09-16 12:48:14.991782982 +0000 UTC m=+18.050291876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret") pod "global-pull-secret-syncer-hrnfn" (UID: "515f7ab2-bbec-4379-9337-2cc15e319b3c") : object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:07.092726 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:07.092660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:07.092726 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:07.092729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:07.092996 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:07.092915 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:07.092996 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:07.092993 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs podName:41775133-5324-474c-9c12-645b149e7113 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:15.092972367 +0000 UTC m=+18.151481262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs") pod "network-metrics-daemon-ltwsm" (UID: "41775133-5324-474c-9c12-645b149e7113") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:07.093115 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:07.093027 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 12:48:07.093115 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:07.093054 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 12:48:07.093115 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:07.093067 2580 projected.go:196] Error preparing data for projected volume kube-api-access-psn9c for pod openshift-network-diagnostics/network-check-target-qsbrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:07.093302 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:07.093134 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c podName:5d997e5a-fd8b-49a0-8264-12e773951182 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:15.093114053 +0000 UTC m=+18.151622946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-psn9c" (UniqueName: "kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c") pod "network-check-target-qsbrp" (UID: "5d997e5a-fd8b-49a0-8264-12e773951182") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:07.397181 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:07.397093 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:07.397347 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:07.397240 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:07.397347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:07.397304 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:07.397465 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:07.397371 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:07.397773 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:07.397743 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:07.399024 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:07.398985 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:09.397640 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:09.397127 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:09.397640 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:09.397280 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:09.397640 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:09.397537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:09.398216 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:09.397663 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:09.398216 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:09.397705 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:09.398216 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:09.397806 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:11.397378 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:11.397346 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:11.397801 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:11.397354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:11.397801 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:11.397456 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:11.397801 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:11.397483 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:11.397801 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:11.397635 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:11.397801 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:11.397712 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:13.396758 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:13.396537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:13.397245 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:13.396547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:13.397245 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:13.396865 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:13.397245 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:13.396550 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:13.397245 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:13.396966 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:13.397245 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:13.397040 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:15.052943 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:15.052912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:15.053337 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.053047 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:15.053337 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.053104 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret podName:515f7ab2-bbec-4379-9337-2cc15e319b3c nodeName:}" failed. No retries permitted until 2026-09-16 12:48:31.053089794 +0000 UTC m=+34.111598689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret") pod "global-pull-secret-syncer-hrnfn" (UID: "515f7ab2-bbec-4379-9337-2cc15e319b3c") : object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:15.153616 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:15.153583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:15.153616 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:15.153615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:15.153868 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.153742 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:15.153868 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.153771 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 12:48:15.153868 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.153793 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs podName:41775133-5324-474c-9c12-645b149e7113 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:31.153776529 +0000 UTC m=+34.212285416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs") pod "network-metrics-daemon-ltwsm" (UID: "41775133-5324-474c-9c12-645b149e7113") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:15.153868 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.153794 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 12:48:15.153868 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.153810 2580 projected.go:196] Error preparing data for projected volume kube-api-access-psn9c for pod openshift-network-diagnostics/network-check-target-qsbrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:15.154087 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.153879 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c podName:5d997e5a-fd8b-49a0-8264-12e773951182 nodeName:}" failed. No retries permitted until 2026-09-16 12:48:31.153862694 +0000 UTC m=+34.212371597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-psn9c" (UniqueName: "kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c") pod "network-check-target-qsbrp" (UID: "5d997e5a-fd8b-49a0-8264-12e773951182") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:15.397155 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:15.397044 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:15.397155 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:15.397085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:15.397155 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:15.397050 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:15.397395 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.397198 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:15.397395 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.397329 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:15.397490 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:15.397402 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:17.397107 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:17.397079 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:17.397561 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:17.397182 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:17.397561 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:17.397276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:17.397561 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:17.397380 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:17.397561 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:17.397420 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:17.397561 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:17.397491 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:19.396619 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.396593 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:19.397352 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.396615 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:19.397352 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:19.396727 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:19.397352 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:19.396802 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:19.397352 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.396878 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:19.397352 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:19.396956 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:19.599122 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.599034 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" event={"ID":"c9fd2062-ecf7-4b58-8aa2-93688aea141e","Type":"ContainerStarted","Data":"af62edf3ca536f111385f81829b65e32003c656c3747fa51d2cd4f67b571d0e8"} Sep 16 12:48:19.600775 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.600742 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ssrrq" event={"ID":"a69a0931-4858-4609-85df-062a0d799e1a","Type":"ContainerStarted","Data":"469a2a1d05194a7dd90e537db988cf71a576fc833483191c8c1816c7a6e9262e"} Sep 16 12:48:19.602574 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.602545 2580 generic.go:356] "Generic (PLEG): container finished" podID="6480cf31-d326-49b5-9689-94759091a386" containerID="3c7682a99872cb19bc91ef23b998dfeee7bbc0f6f6dfa7bb2dc0e1839d4ebbde" exitCode=0 Sep 16 12:48:19.602687 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.602645 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" event={"ID":"6480cf31-d326-49b5-9689-94759091a386","Type":"ContainerDied","Data":"3c7682a99872cb19bc91ef23b998dfeee7bbc0f6f6dfa7bb2dc0e1839d4ebbde"} Sep 16 12:48:19.604437 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.604411 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tkbd4" event={"ID":"d7e30602-572a-4f2c-8618-2890660a5f75","Type":"ContainerStarted","Data":"423a3a98f715cb0ba2fd941b0b7571e29f1eb646bcb1643d3402927deff98ff3"} Sep 16 12:48:19.607952 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.607924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" event={"ID":"2216d776-a5c5-4488-8d66-cf721d1b3f5b","Type":"ContainerStarted","Data":"0b5240a7d4a9ccc5c06ae9261677df1034408058adc4f8426a4fbb5843a40888"} Sep 16 12:48:19.608140 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.607989 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" event={"ID":"2216d776-a5c5-4488-8d66-cf721d1b3f5b","Type":"ContainerStarted","Data":"1321045b3487db6d9bbd0fe29c2fce717d6d769aa5c5427318cc3066a4ec5197"} Sep 16 12:48:19.608140 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.608027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" event={"ID":"2216d776-a5c5-4488-8d66-cf721d1b3f5b","Type":"ContainerStarted","Data":"d7fed03771c7f9fa43c34014ee2baa240b46730d20e9231c961169d8a7b5322c"} Sep 16 12:48:19.608140 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.608063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" event={"ID":"2216d776-a5c5-4488-8d66-cf721d1b3f5b","Type":"ContainerStarted","Data":"86f2d6cd7c6d9f0b3fd71e8181b3b10829ef5883a248d4a40b75804c3a30b461"} Sep 16 12:48:19.608140 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.608093 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" event={"ID":"2216d776-a5c5-4488-8d66-cf721d1b3f5b","Type":"ContainerStarted","Data":"5826395a8baf3b63fd715521c70fec518bf12d591b418ac8b30cd65afec78ea5"} Sep 16 12:48:19.608140 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.608131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" event={"ID":"2216d776-a5c5-4488-8d66-cf721d1b3f5b","Type":"ContainerStarted","Data":"2cffab336f2b225611e31b9297a4ef33eb55ed4e85766c9d00ca958ef8c33503"} Sep 16 12:48:19.609608 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.609577 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k942t" event={"ID":"f2964d87-4632-4930-a87c-0cafa4154548","Type":"ContainerStarted","Data":"789ed3ca61af2bae244277e5b6fce20020320088a236c78e291e18449a3a203f"} Sep 16 12:48:19.611319 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.611295 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xvwcv" event={"ID":"9c9ad48b-5f4c-4a69-bb79-5a1af5918a10","Type":"ContainerStarted","Data":"03a795cfd6143e1573d2725e9183874aa5ae943bb5f8c99382627259665b9c6e"} Sep 16 12:48:19.613021 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.613000 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" event={"ID":"cbf8c1e2-c807-4d5c-90d5-aa46a1020650","Type":"ContainerStarted","Data":"9fe12bebfb0ccd0ef3684dd976b1ba71eb86dc5159f3f524771e58a511599c4f"} Sep 16 12:48:19.615889 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.615835 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ssrrq" podStartSLOduration=3.340724644 podStartE2EDuration="21.615819693s" totalImagesPullingTime="18.275095049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:19.615648311 +0000 UTC m=+22.674157220" watchObservedRunningTime="2026-09-16 12:48:19.615819693 +0000 UTC m=+22.674328600" Sep 16 12:48:19.618595 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.617435 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-26.ec2.internal" podStartSLOduration=20.617417528 podStartE2EDuration="20.617417528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:02.580916872 +0000 UTC m=+5.639425793" watchObservedRunningTime="2026-09-16 12:48:19.617417528 +0000 UTC m=+22.675926440" Sep 16 12:48:19.631992 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.631948 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tkbd4" podStartSLOduration=7.160570218 podStartE2EDuration="21.631931191s" totalImagesPullingTime="14.471360973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:19.631663484 +0000 UTC m=+22.690172393" watchObservedRunningTime="2026-09-16 12:48:19.631931191 +0000 UTC m=+22.690440101" Sep 16 12:48:19.686054 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.686013 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hpm2d" podStartSLOduration=3.402161253 podStartE2EDuration="21.686000707s" totalImagesPullingTime="18.283839454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:19.672031172 +0000 UTC m=+22.730540072" watchObservedRunningTime="2026-09-16 12:48:19.686000707 +0000 UTC m=+22.744509614" Sep 16 12:48:19.686172 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.686137 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k942t" podStartSLOduration=3.41294512 podStartE2EDuration="21.686130097s" totalImagesPullingTime="18.273184977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:19.685534527 +0000 UTC m=+22.744043436" watchObservedRunningTime="2026-09-16 12:48:19.686130097 +0000 UTC m=+22.744639007" Sep 16 12:48:19.702112 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:19.702070 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xvwcv" podStartSLOduration=3.3579183329999998 podStartE2EDuration="21.702058299s" totalImagesPullingTime="18.344139966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:19.701609313 +0000 UTC m=+22.760118221" watchObservedRunningTime="2026-09-16 12:48:19.702058299 +0000 UTC m=+22.760567208" Sep 16 12:48:20.261295 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:20.261213 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 16 12:48:20.372763 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:20.372664 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T12:48:20.261233527Z","UUID":"f555cec6-1a7e-4e4c-89f3-dd6d011f9f63","Handler":null,"Name":"","Endpoint":""} Sep 16 12:48:20.375735 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:20.375709 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 16 12:48:20.375875 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:20.375746 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 16 12:48:20.617889 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:20.617754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-59nfp" event={"ID":"4b5af094-de84-470d-b07b-5be03e6277a6","Type":"ContainerStarted","Data":"e2180e32269911b5d3ae5aa35382b8fc08d02cf1ee4c1c33edbb7e20f654e011"} Sep 16 12:48:20.619957 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:20.619927 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" event={"ID":"c9fd2062-ecf7-4b58-8aa2-93688aea141e","Type":"ContainerStarted","Data":"699268654dfad1d5f67d0da73fb51eb2d0eddd03ec0dc674a89c9f364040a478"} Sep 16 12:48:20.631539 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:20.631498 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-59nfp" podStartSLOduration=4.360928765 podStartE2EDuration="22.63148271s" totalImagesPullingTime="18.270553945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:20.631254639 +0000 UTC m=+23.689763549" watchObservedRunningTime="2026-09-16 12:48:20.63148271 +0000 UTC m=+23.689991619" Sep 16 12:48:21.396811 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:21.396732 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:21.396977 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:21.396732 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:21.396977 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:21.396864 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:21.396977 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:21.396746 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:21.397156 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:21.396969 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:21.397156 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:21.397095 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:21.569832 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:21.569786 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:48:21.624813 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:21.624349 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" event={"ID":"c9fd2062-ecf7-4b58-8aa2-93688aea141e","Type":"ContainerStarted","Data":"10c0eabd9515640e7f4c767871e1122e8edc6322098503ea4c240d1cd6e04df3"} Sep 16 12:48:21.628523 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:21.628495 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" event={"ID":"2216d776-a5c5-4488-8d66-cf721d1b3f5b","Type":"ContainerStarted","Data":"ed8de91ef4821c7bfede6c167d74521cebd16fe68c773c255c6aaca3e7c3da18"} Sep 16 12:48:21.641609 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:21.641560 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c94p" podStartSLOduration=3.414444803 podStartE2EDuration="23.641546495s" totalImagesPullingTime="20.227101692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:21.640866795 +0000 UTC m=+24.699375701" watchObservedRunningTime="2026-09-16 12:48:21.641546495 +0000 UTC m=+24.700055404" Sep 16 12:48:23.397285 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:23.397250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:23.397743 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:23.397250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:23.397743 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:23.397393 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:23.397743 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:23.397393 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:23.397743 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:23.397462 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:23.397743 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:23.397512 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:23.515173 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:23.515142 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:48:23.515775 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:23.515751 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:48:23.633285 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:23.633263 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tkbd4" Sep 16 12:48:24.637210 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:24.637017 2580 generic.go:356] "Generic (PLEG): container finished" podID="6480cf31-d326-49b5-9689-94759091a386" containerID="d4a133b3e299bdce8488af67147c4e9c9510a262566036aade7f6eb0fb337754" exitCode=0 Sep 16 12:48:24.637654 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:24.637094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" event={"ID":"6480cf31-d326-49b5-9689-94759091a386","Type":"ContainerDied","Data":"d4a133b3e299bdce8488af67147c4e9c9510a262566036aade7f6eb0fb337754"} Sep 16 12:48:24.644027 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:24.644000 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" event={"ID":"2216d776-a5c5-4488-8d66-cf721d1b3f5b","Type":"ContainerStarted","Data":"49a6baef921846e6b31e20b9ebce7de7c4b4a2c1529cfa9bf49edb25d34b53aa"} Sep 16 12:48:24.644277 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:24.644256 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:48:24.644390 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:24.644320 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:48:24.659281 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:24.659257 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:48:24.659418 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:24.659355 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:48:24.694445 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:24.694403 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" podStartSLOduration=8.359998308 podStartE2EDuration="26.694389382s" totalImagesPullingTime="18.334391074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:24.69305008 +0000 UTC m=+27.751558988" watchObservedRunningTime="2026-09-16 12:48:24.694389382 +0000 UTC m=+27.752898290" Sep 16 12:48:25.397392 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.397324 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:25.397392 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.397336 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:25.397629 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:25.397446 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:25.397629 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.397505 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:25.397629 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:25.397615 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:25.397891 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:25.397705 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:25.646380 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.646350 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 12:48:25.662483 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.662409 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrnfn"] Sep 16 12:48:25.662631 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.662510 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:25.662631 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:25.662611 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:25.665064 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.665039 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qsbrp"] Sep 16 12:48:25.665190 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.665134 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:25.665256 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:25.665220 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:25.675207 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.675180 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ltwsm"] Sep 16 12:48:25.675304 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:25.675275 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:25.675398 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:25.675373 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:26.329211 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:26.329191 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:48:26.650620 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:26.650541 2580 generic.go:356] "Generic (PLEG): container finished" podID="6480cf31-d326-49b5-9689-94759091a386" containerID="89064df664962e46b6b8a6e29be33ccd7a41bc1b600506a4cf4be8cf360266cc" exitCode=0 Sep 16 12:48:26.650993 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:26.650618 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" event={"ID":"6480cf31-d326-49b5-9689-94759091a386","Type":"ContainerDied","Data":"89064df664962e46b6b8a6e29be33ccd7a41bc1b600506a4cf4be8cf360266cc"} Sep 16 12:48:27.396956 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:27.396925 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:27.397105 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:27.397032 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:27.397105 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:27.397055 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:27.397105 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:27.397076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:27.397266 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:27.397151 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:27.397266 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:27.397229 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:27.654903 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:27.654870 2580 generic.go:356] "Generic (PLEG): container finished" podID="6480cf31-d326-49b5-9689-94759091a386" containerID="e7f51c4e2426b2a55174c20c2cabeb4933fd9343d6bcf3c04b9b72d451c7db54" exitCode=0 Sep 16 12:48:27.655267 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:27.654959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" event={"ID":"6480cf31-d326-49b5-9689-94759091a386","Type":"ContainerDied","Data":"e7f51c4e2426b2a55174c20c2cabeb4933fd9343d6bcf3c04b9b72d451c7db54"} Sep 16 12:48:29.397378 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:29.397341 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:29.397877 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:29.397482 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:29.397877 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:29.397622 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:29.397877 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:29.397733 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:29.397877 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:29.397341 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:29.397877 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:29.397811 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:31.072715 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:31.072628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:31.073215 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.072797 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:31.073215 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.072880 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret podName:515f7ab2-bbec-4379-9337-2cc15e319b3c nodeName:}" failed. No retries permitted until 2026-09-16 12:49:03.072864734 +0000 UTC m=+66.131373621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret") pod "global-pull-secret-syncer-hrnfn" (UID: "515f7ab2-bbec-4379-9337-2cc15e319b3c") : object "kube-system"/"original-pull-secret" not registered Sep 16 12:48:31.173373 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:31.173337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:31.173373 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:31.173378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:31.173607 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.173494 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:31.173607 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.173511 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 12:48:31.173607 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.173538 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 12:48:31.173607 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.173552 2580 projected.go:196] Error preparing data for projected volume kube-api-access-psn9c for pod openshift-network-diagnostics/network-check-target-qsbrp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:31.173607 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.173556 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs podName:41775133-5324-474c-9c12-645b149e7113 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:03.173541463 +0000 UTC m=+66.232050349 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs") pod "network-metrics-daemon-ltwsm" (UID: "41775133-5324-474c-9c12-645b149e7113") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 12:48:31.173607 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.173601 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c podName:5d997e5a-fd8b-49a0-8264-12e773951182 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:03.173584922 +0000 UTC m=+66.232093812 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-psn9c" (UniqueName: "kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c") pod "network-check-target-qsbrp" (UID: "5d997e5a-fd8b-49a0-8264-12e773951182") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 12:48:31.396768 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:31.396738 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:31.396961 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:31.396779 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:31.396961 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:31.396834 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:31.396961 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.396865 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qsbrp" podUID="5d997e5a-fd8b-49a0-8264-12e773951182" Sep 16 12:48:31.396961 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.396918 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrnfn" podUID="515f7ab2-bbec-4379-9337-2cc15e319b3c" Sep 16 12:48:31.397188 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:31.397004 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltwsm" podUID="41775133-5324-474c-9c12-645b149e7113" Sep 16 12:48:32.669188 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.669163 2580 generic.go:356] "Generic (PLEG): container finished" podID="6480cf31-d326-49b5-9689-94759091a386" containerID="a2dcc803a76b17026e58ae54f336fe0809907a72603ac28201dd04b11d1e5b6d" exitCode=0 Sep 16 12:48:32.669539 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.669215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" event={"ID":"6480cf31-d326-49b5-9689-94759091a386","Type":"ContainerDied","Data":"a2dcc803a76b17026e58ae54f336fe0809907a72603ac28201dd04b11d1e5b6d"} Sep 16 12:48:32.704668 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.703982 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-26.ec2.internal" event="NodeReady" Sep 16 12:48:32.704668 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.704113 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 16 12:48:32.766162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.766003 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-52rdp"] Sep 16 12:48:32.809758 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.809706 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bg2ml"] Sep 16 12:48:32.809912 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.809881 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:32.811926 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.811904 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 16 12:48:32.812028 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.811933 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 16 12:48:32.812028 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.811913 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sl6fp\"" Sep 16 12:48:32.823953 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.823937 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bg2ml"] Sep 16 12:48:32.824038 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.823961 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-52rdp"] Sep 16 12:48:32.824038 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.824024 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bg2ml" Sep 16 12:48:32.826610 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.826594 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-54qld\"" Sep 16 12:48:32.826821 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.826808 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 16 12:48:32.827010 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.826995 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 16 12:48:32.827080 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.827066 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 16 12:48:32.985150 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.985074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8713b81d-6d5f-4a95-8d12-71c32c6b8c30-cert\") pod \"ingress-canary-bg2ml\" (UID: \"8713b81d-6d5f-4a95-8d12-71c32c6b8c30\") " pod="openshift-ingress-canary/ingress-canary-bg2ml" Sep 16 12:48:32.985287 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.985164 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2wlt\" (UniqueName: \"kubernetes.io/projected/a0054dc8-ac6f-4632-a637-68ba44d9aeae-kube-api-access-b2wlt\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:32.985287 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.985195 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0054dc8-ac6f-4632-a637-68ba44d9aeae-config-volume\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:32.985287 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.985221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0054dc8-ac6f-4632-a637-68ba44d9aeae-tmp-dir\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:32.985287 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.985247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cjqr\" (UniqueName: \"kubernetes.io/projected/8713b81d-6d5f-4a95-8d12-71c32c6b8c30-kube-api-access-8cjqr\") pod \"ingress-canary-bg2ml\" (UID: \"8713b81d-6d5f-4a95-8d12-71c32c6b8c30\") " pod="openshift-ingress-canary/ingress-canary-bg2ml" Sep 16 12:48:32.985287 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:32.985263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:33.086470 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.086427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0054dc8-ac6f-4632-a637-68ba44d9aeae-config-volume\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:33.086470 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.086475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0054dc8-ac6f-4632-a637-68ba44d9aeae-tmp-dir\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:33.086700 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.086494 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cjqr\" (UniqueName: \"kubernetes.io/projected/8713b81d-6d5f-4a95-8d12-71c32c6b8c30-kube-api-access-8cjqr\") pod \"ingress-canary-bg2ml\" (UID: \"8713b81d-6d5f-4a95-8d12-71c32c6b8c30\") " pod="openshift-ingress-canary/ingress-canary-bg2ml" Sep 16 12:48:33.086700 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.086683 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:33.086802 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.086750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8713b81d-6d5f-4a95-8d12-71c32c6b8c30-cert\") pod \"ingress-canary-bg2ml\" (UID: \"8713b81d-6d5f-4a95-8d12-71c32c6b8c30\") " pod="openshift-ingress-canary/ingress-canary-bg2ml" Sep 16 12:48:33.086802 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.086780 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0054dc8-ac6f-4632-a637-68ba44d9aeae-tmp-dir\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:33.086928 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:33.086821 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 12:48:33.086928 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:33.086920 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls podName:a0054dc8-ac6f-4632-a637-68ba44d9aeae nodeName:}" failed. No retries permitted until 2026-09-16 12:48:33.586900117 +0000 UTC m=+36.645409025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls") pod "dns-default-52rdp" (UID: "a0054dc8-ac6f-4632-a637-68ba44d9aeae") : secret "dns-default-metrics-tls" not found Sep 16 12:48:33.087037 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.086826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2wlt\" (UniqueName: \"kubernetes.io/projected/a0054dc8-ac6f-4632-a637-68ba44d9aeae-kube-api-access-b2wlt\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:33.087149 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.087119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a0054dc8-ac6f-4632-a637-68ba44d9aeae-config-volume\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:33.090835 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.090814 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8713b81d-6d5f-4a95-8d12-71c32c6b8c30-cert\") pod \"ingress-canary-bg2ml\" (UID: \"8713b81d-6d5f-4a95-8d12-71c32c6b8c30\") " pod="openshift-ingress-canary/ingress-canary-bg2ml" Sep 16 12:48:33.102513 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.102488 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2wlt\" (UniqueName: \"kubernetes.io/projected/a0054dc8-ac6f-4632-a637-68ba44d9aeae-kube-api-access-b2wlt\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:33.102632 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.102615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cjqr\" (UniqueName: \"kubernetes.io/projected/8713b81d-6d5f-4a95-8d12-71c32c6b8c30-kube-api-access-8cjqr\") pod \"ingress-canary-bg2ml\" (UID: \"8713b81d-6d5f-4a95-8d12-71c32c6b8c30\") " pod="openshift-ingress-canary/ingress-canary-bg2ml" Sep 16 12:48:33.131162 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.131143 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bg2ml" Sep 16 12:48:33.397024 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.396991 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:48:33.397202 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.397104 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:48:33.397202 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.396998 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:48:33.399334 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.399307 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 12:48:33.399447 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.399392 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 12:48:33.400056 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.400039 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27x5j\"" Sep 16 12:48:33.400155 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.400053 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 12:48:33.400155 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.400086 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-djtjx\"" Sep 16 12:48:33.401750 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.401735 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 12:48:33.438996 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.438974 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bg2ml"] Sep 16 12:48:33.442045 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:48:33.442020 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8713b81d_6d5f_4a95_8d12_71c32c6b8c30.slice/crio-5ca82f90e96a4d0d0de2f2e6baf2da5e3f9824823edc3d4a2be586442dbb2a96 WatchSource:0}: Error finding container 5ca82f90e96a4d0d0de2f2e6baf2da5e3f9824823edc3d4a2be586442dbb2a96: Status 404 returned error can't find the container with id 5ca82f90e96a4d0d0de2f2e6baf2da5e3f9824823edc3d4a2be586442dbb2a96 Sep 16 12:48:33.590715 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.590685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:33.590840 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:33.590830 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 12:48:33.590919 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:33.590908 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls podName:a0054dc8-ac6f-4632-a637-68ba44d9aeae nodeName:}" failed. No retries permitted until 2026-09-16 12:48:34.590890629 +0000 UTC m=+37.649399516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls") pod "dns-default-52rdp" (UID: "a0054dc8-ac6f-4632-a637-68ba44d9aeae") : secret "dns-default-metrics-tls" not found Sep 16 12:48:33.672588 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.672511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bg2ml" event={"ID":"8713b81d-6d5f-4a95-8d12-71c32c6b8c30","Type":"ContainerStarted","Data":"5ca82f90e96a4d0d0de2f2e6baf2da5e3f9824823edc3d4a2be586442dbb2a96"} Sep 16 12:48:33.675596 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.675572 2580 generic.go:356] "Generic (PLEG): container finished" podID="6480cf31-d326-49b5-9689-94759091a386" containerID="eca0d33c34939063532a965ce4736cc9782cdb6adfa0b5499279abbd7d8681c2" exitCode=0 Sep 16 12:48:33.675713 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:33.675603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" event={"ID":"6480cf31-d326-49b5-9689-94759091a386","Type":"ContainerDied","Data":"eca0d33c34939063532a965ce4736cc9782cdb6adfa0b5499279abbd7d8681c2"} Sep 16 12:48:34.600117 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:34.600084 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:34.600308 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:34.600272 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 12:48:34.600400 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:34.600387 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls podName:a0054dc8-ac6f-4632-a637-68ba44d9aeae nodeName:}" failed. No retries permitted until 2026-09-16 12:48:36.600367609 +0000 UTC m=+39.658876496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls") pod "dns-default-52rdp" (UID: "a0054dc8-ac6f-4632-a637-68ba44d9aeae") : secret "dns-default-metrics-tls" not found Sep 16 12:48:34.683126 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:34.682935 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" event={"ID":"6480cf31-d326-49b5-9689-94759091a386","Type":"ContainerStarted","Data":"b29048c3caa82299c5c8d528b0f165eefa96f1132b06d5df364ee4afa34f8e31"} Sep 16 12:48:35.687981 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:35.687934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bg2ml" event={"ID":"8713b81d-6d5f-4a95-8d12-71c32c6b8c30","Type":"ContainerStarted","Data":"b35011b953b4fb9e5ed45414c852dc86f4b09721cae7afb66ef643ec9297b86a"} Sep 16 12:48:35.720388 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:35.720336 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tmjfb" podStartSLOduration=8.856660536 podStartE2EDuration="37.720316229s" totalImagesPullingTime="28.863655693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:34.720775288 +0000 UTC m=+37.779284188" watchObservedRunningTime="2026-09-16 12:48:35.720316229 +0000 UTC m=+38.778825139" Sep 16 12:48:35.720787 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:35.720762 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bg2ml" podStartSLOduration=1.640553276 podStartE2EDuration="3.720755631s" totalImagesPullingTime="2.080202355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:35.720463722 +0000 UTC m=+38.778972622" watchObservedRunningTime="2026-09-16 12:48:35.720755631 +0000 UTC m=+38.779264540" Sep 16 12:48:36.617250 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:36.617213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:36.617415 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:36.617360 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 12:48:36.617415 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:36.617410 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls podName:a0054dc8-ac6f-4632-a637-68ba44d9aeae nodeName:}" failed. No retries permitted until 2026-09-16 12:48:40.617397899 +0000 UTC m=+43.675906786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls") pod "dns-default-52rdp" (UID: "a0054dc8-ac6f-4632-a637-68ba44d9aeae") : secret "dns-default-metrics-tls" not found Sep 16 12:48:40.641265 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:40.641221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:40.641635 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:40.641380 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 12:48:40.641635 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:40.641455 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls podName:a0054dc8-ac6f-4632-a637-68ba44d9aeae nodeName:}" failed. No retries permitted until 2026-09-16 12:48:48.641437667 +0000 UTC m=+51.699946554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls") pod "dns-default-52rdp" (UID: "a0054dc8-ac6f-4632-a637-68ba44d9aeae") : secret "dns-default-metrics-tls" not found Sep 16 12:48:48.696380 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:48.696340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:48:48.696785 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:48.696449 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 12:48:48.696785 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:48:48.696499 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls podName:a0054dc8-ac6f-4632-a637-68ba44d9aeae nodeName:}" failed. No retries permitted until 2026-09-16 12:49:04.696485063 +0000 UTC m=+67.754993950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls") pod "dns-default-52rdp" (UID: "a0054dc8-ac6f-4632-a637-68ba44d9aeae") : secret "dns-default-metrics-tls" not found Sep 16 12:48:57.665536 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:48:57.665508 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k6ccb" Sep 16 12:49:03.088036 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.087982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:49:03.091457 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.091433 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 12:49:03.102316 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.102298 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/515f7ab2-bbec-4379-9337-2cc15e319b3c-original-pull-secret\") pod \"global-pull-secret-syncer-hrnfn\" (UID: \"515f7ab2-bbec-4379-9337-2cc15e319b3c\") " pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:49:03.117605 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.117583 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrnfn" Sep 16 12:49:03.189141 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.189110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:49:03.189256 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.189150 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:49:03.191375 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.191348 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 12:49:03.191499 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.191440 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 12:49:03.199971 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:03.199951 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 16 12:49:03.200064 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:03.200037 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs podName:41775133-5324-474c-9c12-645b149e7113 nodeName:}" failed. No retries permitted until 2026-09-16 12:50:07.200018704 +0000 UTC m=+130.258527590 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs") pod "network-metrics-daemon-ltwsm" (UID: "41775133-5324-474c-9c12-645b149e7113") : secret "metrics-daemon-secret" not found Sep 16 12:49:03.202024 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.202007 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 12:49:03.212958 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.212933 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psn9c\" (UniqueName: \"kubernetes.io/projected/5d997e5a-fd8b-49a0-8264-12e773951182-kube-api-access-psn9c\") pod \"network-check-target-qsbrp\" (UID: \"5d997e5a-fd8b-49a0-8264-12e773951182\") " pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:49:03.389122 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.389048 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrnfn"] Sep 16 12:49:03.392229 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:03.392205 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515f7ab2_bbec_4379_9337_2cc15e319b3c.slice/crio-bd10758a6629e2dac35e6640c351bb2c6ba7f8ec11d51ce787893731b695bd40 WatchSource:0}: Error finding container bd10758a6629e2dac35e6640c351bb2c6ba7f8ec11d51ce787893731b695bd40: Status 404 returned error can't find the container with id bd10758a6629e2dac35e6640c351bb2c6ba7f8ec11d51ce787893731b695bd40 Sep 16 12:49:03.411528 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.411511 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-djtjx\"" Sep 16 12:49:03.418263 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.418244 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:49:03.685300 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.685228 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qsbrp"] Sep 16 12:49:03.688240 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:03.688212 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d997e5a_fd8b_49a0_8264_12e773951182.slice/crio-c6ddd82e9db5094d8b131cfdea63b9dec1188e23356f6b747da7e408f383f1e7 WatchSource:0}: Error finding container c6ddd82e9db5094d8b131cfdea63b9dec1188e23356f6b747da7e408f383f1e7: Status 404 returned error can't find the container with id c6ddd82e9db5094d8b131cfdea63b9dec1188e23356f6b747da7e408f383f1e7 Sep 16 12:49:03.749946 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.749914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qsbrp" event={"ID":"5d997e5a-fd8b-49a0-8264-12e773951182","Type":"ContainerStarted","Data":"c6ddd82e9db5094d8b131cfdea63b9dec1188e23356f6b747da7e408f383f1e7"} Sep 16 12:49:03.750978 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:03.750955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrnfn" event={"ID":"515f7ab2-bbec-4379-9337-2cc15e319b3c","Type":"ContainerStarted","Data":"bd10758a6629e2dac35e6640c351bb2c6ba7f8ec11d51ce787893731b695bd40"} Sep 16 12:49:04.702829 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:04.702788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:49:04.703339 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:04.702972 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 16 12:49:04.703339 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:04.703051 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls podName:a0054dc8-ac6f-4632-a637-68ba44d9aeae nodeName:}" failed. No retries permitted until 2026-09-16 12:49:36.703031023 +0000 UTC m=+99.761539926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls") pod "dns-default-52rdp" (UID: "a0054dc8-ac6f-4632-a637-68ba44d9aeae") : secret "dns-default-metrics-tls" not found Sep 16 12:49:05.705805 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.705644 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-28v7h"] Sep 16 12:49:05.710466 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.710411 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.724363 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.724329 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 16 12:49:05.724665 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.724651 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 16 12:49:05.724883 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.724806 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 16 12:49:05.725096 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.725063 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 16 12:49:05.725205 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.725063 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rmmmz\"" Sep 16 12:49:05.726411 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.726391 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg"] Sep 16 12:49:05.729515 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.729495 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 16 12:49:05.729958 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.729924 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-28v7h"] Sep 16 12:49:05.730068 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.730034 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:05.732107 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.732088 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 16 12:49:05.733202 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.733182 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 16 12:49:05.733530 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.733194 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 16 12:49:05.733618 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.733235 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 16 12:49:05.737142 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.736962 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6nnzb\"" Sep 16 12:49:05.742418 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.742386 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg"] Sep 16 12:49:05.742980 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.742960 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq"] Sep 16 12:49:05.746043 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.745993 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:05.747212 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.747189 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2"] Sep 16 12:49:05.749473 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.749429 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 16 12:49:05.749831 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.749811 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 16 12:49:05.750182 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.750163 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2" Sep 16 12:49:05.751018 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.750999 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 16 12:49:05.751153 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.751127 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gww9s\"" Sep 16 12:49:05.752595 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.752566 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 16 12:49:05.752862 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.752779 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jphpv\"" Sep 16 12:49:05.753223 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.753203 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 16 12:49:05.764513 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.764413 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq"] Sep 16 12:49:05.765400 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.765379 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2"] Sep 16 12:49:05.809557 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:05.809702 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-serving-cert\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.809702 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d40458f-6f54-4098-b0c4-11a5a069f6fc-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:05.809702 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnnqj\" (UniqueName: \"kubernetes.io/projected/672bd470-9bc1-44f2-b42b-aa861ff950be-kube-api-access-cnnqj\") pod \"volume-data-source-validator-86695b7cc7-968j2\" (UID: \"672bd470-9bc1-44f2-b42b-aa861ff950be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2" Sep 16 12:49:05.809702 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62mm5\" (UniqueName: \"kubernetes.io/projected/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-kube-api-access-62mm5\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.809940 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-tmp\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.809940 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809821 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-service-ca-bundle\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.809940 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809872 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n4zf\" (UniqueName: \"kubernetes.io/projected/6d40458f-6f54-4098-b0c4-11a5a069f6fc-kube-api-access-6n4zf\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:05.809940 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809896 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-snapshots\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.810156 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.809962 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-trusted-ca-bundle\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.810156 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.810030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:05.810156 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.810056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js5p2\" (UniqueName: \"kubernetes.io/projected/0432ce6c-3636-4dd7-8f0f-de1fde07a726-kube-api-access-js5p2\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:05.846863 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.846820 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77c775b46-wls6m"] Sep 16 12:49:05.849940 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.849919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:05.855574 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.855550 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 16 12:49:05.855706 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.855562 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7lm6g\"" Sep 16 12:49:05.855706 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.855670 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 16 12:49:05.856691 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.856674 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 16 12:49:05.866768 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.866744 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 16 12:49:05.873168 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.873145 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c775b46-wls6m"] Sep 16 12:49:05.910364 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-serving-cert\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.910538 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d40458f-6f54-4098-b0c4-11a5a069f6fc-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:05.910538 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910413 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnnqj\" (UniqueName: \"kubernetes.io/projected/672bd470-9bc1-44f2-b42b-aa861ff950be-kube-api-access-cnnqj\") pod \"volume-data-source-validator-86695b7cc7-968j2\" (UID: \"672bd470-9bc1-44f2-b42b-aa861ff950be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2" Sep 16 12:49:05.910538 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62mm5\" (UniqueName: \"kubernetes.io/projected/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-kube-api-access-62mm5\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.910538 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:05.910538 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910499 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-bound-sa-token\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:05.910538 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvbkm\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-kube-api-access-jvbkm\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:05.910817 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-tmp\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.910817 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-service-ca-bundle\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.910817 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n4zf\" (UniqueName: \"kubernetes.io/projected/6d40458f-6f54-4098-b0c4-11a5a069f6fc-kube-api-access-6n4zf\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:05.910817 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-snapshots\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.910817 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-ca-trust-extracted\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:05.910817 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-certificates\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:05.910817 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-trusted-ca-bundle\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.910817 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-image-registry-private-configuration\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:05.911279 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-trusted-ca\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:05.911279 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:05.911279 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js5p2\" (UniqueName: \"kubernetes.io/projected/0432ce6c-3636-4dd7-8f0f-de1fde07a726-kube-api-access-js5p2\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:05.911279 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.910978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:05.911279 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.911004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-installation-pull-secrets\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:05.911527 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.911292 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-tmp\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.911527 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:05.911325 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:05.911527 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:05.911393 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 12:49:05.911527 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:05.911429 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls podName:6d40458f-6f54-4098-b0c4-11a5a069f6fc nodeName:}" failed. No retries permitted until 2026-09-16 12:49:06.411409434 +0000 UTC m=+69.469918343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qngjg" (UID: "6d40458f-6f54-4098-b0c4-11a5a069f6fc") : secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:05.911527 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:05.911477 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls podName:0432ce6c-3636-4dd7-8f0f-de1fde07a726 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:06.411457966 +0000 UTC m=+69.469966866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zslbq" (UID: "0432ce6c-3636-4dd7-8f0f-de1fde07a726") : secret "samples-operator-tls" not found Sep 16 12:49:05.911789 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.911566 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-service-ca-bundle\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.912031 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.912001 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d40458f-6f54-4098-b0c4-11a5a069f6fc-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:05.912152 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.912041 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-snapshots\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.912268 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.912247 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-trusted-ca-bundle\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.914896 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.914872 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-serving-cert\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.927033 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.926986 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n4zf\" (UniqueName: \"kubernetes.io/projected/6d40458f-6f54-4098-b0c4-11a5a069f6fc-kube-api-access-6n4zf\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:05.928480 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.928454 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62mm5\" (UniqueName: \"kubernetes.io/projected/1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f-kube-api-access-62mm5\") pod \"insights-operator-5844b856db-28v7h\" (UID: \"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f\") " pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:05.928927 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.928871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnnqj\" (UniqueName: \"kubernetes.io/projected/672bd470-9bc1-44f2-b42b-aa861ff950be-kube-api-access-cnnqj\") pod \"volume-data-source-validator-86695b7cc7-968j2\" (UID: \"672bd470-9bc1-44f2-b42b-aa861ff950be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2" Sep 16 12:49:05.929481 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:05.929437 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js5p2\" (UniqueName: \"kubernetes.io/projected/0432ce6c-3636-4dd7-8f0f-de1fde07a726-kube-api-access-js5p2\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:06.012061 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.011977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-bound-sa-token\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.012061 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.012021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvbkm\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-kube-api-access-jvbkm\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.012276 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.012102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-ca-trust-extracted\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.012276 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.012131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-certificates\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.012276 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.012195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-image-registry-private-configuration\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.012276 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.012218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-trusted-ca\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.012276 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.012264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-installation-pull-secrets\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.012522 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.012304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.012522 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.012398 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 12:49:06.012522 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.012418 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c775b46-wls6m: secret "image-registry-tls" not found Sep 16 12:49:06.012522 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.012475 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls podName:91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:06.512455849 +0000 UTC m=+69.570964754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls") pod "image-registry-77c775b46-wls6m" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0") : secret "image-registry-tls" not found Sep 16 12:49:06.012738 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.012568 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-ca-trust-extracted\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.012837 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.012816 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-certificates\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.013324 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.013279 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-trusted-ca\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.015506 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.015480 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-installation-pull-secrets\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.015616 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.015485 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-image-registry-private-configuration\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.022357 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.022333 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-28v7h" Sep 16 12:49:06.034274 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.034253 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvbkm\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-kube-api-access-jvbkm\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.038751 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.038728 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-bound-sa-token\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.073216 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.073191 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2" Sep 16 12:49:06.415367 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.415334 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:06.415564 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.415382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:06.415564 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.415492 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 12:49:06.415564 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.415495 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:06.415564 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.415557 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls podName:0432ce6c-3636-4dd7-8f0f-de1fde07a726 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:07.415539164 +0000 UTC m=+70.474048052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zslbq" (UID: "0432ce6c-3636-4dd7-8f0f-de1fde07a726") : secret "samples-operator-tls" not found Sep 16 12:49:06.415768 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.415576 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls podName:6d40458f-6f54-4098-b0c4-11a5a069f6fc nodeName:}" failed. No retries permitted until 2026-09-16 12:49:07.415567316 +0000 UTC m=+70.474076207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qngjg" (UID: "6d40458f-6f54-4098-b0c4-11a5a069f6fc") : secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:06.516713 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:06.516677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:06.516883 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.516830 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 12:49:06.516883 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.516863 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c775b46-wls6m: secret "image-registry-tls" not found Sep 16 12:49:06.516960 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:06.516932 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls podName:91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:07.516914684 +0000 UTC m=+70.575423572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls") pod "image-registry-77c775b46-wls6m" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0") : secret "image-registry-tls" not found Sep 16 12:49:07.424858 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:07.424813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:07.425307 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:07.424958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:07.425307 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:07.424962 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:07.425307 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:07.425037 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls podName:6d40458f-6f54-4098-b0c4-11a5a069f6fc nodeName:}" failed. No retries permitted until 2026-09-16 12:49:09.425016091 +0000 UTC m=+72.483524991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qngjg" (UID: "6d40458f-6f54-4098-b0c4-11a5a069f6fc") : secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:07.425307 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:07.425075 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 12:49:07.425307 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:07.425131 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls podName:0432ce6c-3636-4dd7-8f0f-de1fde07a726 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:09.425119207 +0000 UTC m=+72.483628094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zslbq" (UID: "0432ce6c-3636-4dd7-8f0f-de1fde07a726") : secret "samples-operator-tls" not found Sep 16 12:49:07.525761 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:07.525719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:07.525961 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:07.525897 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 12:49:07.525961 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:07.525921 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c775b46-wls6m: secret "image-registry-tls" not found Sep 16 12:49:07.526076 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:07.525981 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls podName:91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:09.525962834 +0000 UTC m=+72.584471721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls") pod "image-registry-77c775b46-wls6m" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0") : secret "image-registry-tls" not found Sep 16 12:49:08.620208 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:08.620126 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2"] Sep 16 12:49:08.624412 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:08.624378 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672bd470_9bc1_44f2_b42b_aa861ff950be.slice/crio-f06389600ce248cea0d3a440627a09e4088b8c8c48c33e4e215b4dca89537f58 WatchSource:0}: Error finding container f06389600ce248cea0d3a440627a09e4088b8c8c48c33e4e215b4dca89537f58: Status 404 returned error can't find the container with id f06389600ce248cea0d3a440627a09e4088b8c8c48c33e4e215b4dca89537f58 Sep 16 12:49:08.626576 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:08.626504 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-28v7h"] Sep 16 12:49:08.629721 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:08.629698 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4e0b2c_7586_4ee1_8d8e_4b155fcc331f.slice/crio-999e3e31bbb74e03a17fff28ce2e3ec879b37b2f2814210a95794b4bc0004051 WatchSource:0}: Error finding container 999e3e31bbb74e03a17fff28ce2e3ec879b37b2f2814210a95794b4bc0004051: Status 404 returned error can't find the container with id 999e3e31bbb74e03a17fff28ce2e3ec879b37b2f2814210a95794b4bc0004051 Sep 16 12:49:08.769607 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:08.769577 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2" event={"ID":"672bd470-9bc1-44f2-b42b-aa861ff950be","Type":"ContainerStarted","Data":"f06389600ce248cea0d3a440627a09e4088b8c8c48c33e4e215b4dca89537f58"} Sep 16 12:49:08.771174 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:08.771151 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrnfn" event={"ID":"515f7ab2-bbec-4379-9337-2cc15e319b3c","Type":"ContainerStarted","Data":"64be1d543a3ca56754713c655085e607728bc7dbb537b50ab9fb5042d3969a4c"} Sep 16 12:49:08.772300 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:08.772277 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-28v7h" event={"ID":"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f","Type":"ContainerStarted","Data":"999e3e31bbb74e03a17fff28ce2e3ec879b37b2f2814210a95794b4bc0004051"} Sep 16 12:49:08.773658 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:08.773639 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qsbrp" event={"ID":"5d997e5a-fd8b-49a0-8264-12e773951182","Type":"ContainerStarted","Data":"08543314c65e3a71467425747c29f7519817eff7deaf4796be3dc0259058dfb4"} Sep 16 12:49:08.773808 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:08.773783 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:49:08.788291 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:08.788250 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hrnfn" podStartSLOduration=65.809601263 podStartE2EDuration="1m10.788238154s" totalImagesPullingTime="4.978636891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:08.786711924 +0000 UTC m=+71.845220837" watchObservedRunningTime="2026-09-16 12:49:08.788238154 +0000 UTC m=+71.846747063" Sep 16 12:49:08.806226 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:08.806185 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qsbrp" podStartSLOduration=66.139142585 podStartE2EDuration="1m10.806172709s" totalImagesPullingTime="4.667030124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:08.805003621 +0000 UTC m=+71.863512530" watchObservedRunningTime="2026-09-16 12:49:08.806172709 +0000 UTC m=+71.864681618" Sep 16 12:49:09.443496 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:09.443467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:09.443496 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:09.443500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:09.443701 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:09.443620 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 12:49:09.443701 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:09.443623 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:09.443701 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:09.443684 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls podName:0432ce6c-3636-4dd7-8f0f-de1fde07a726 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:13.443666524 +0000 UTC m=+76.502175425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zslbq" (UID: "0432ce6c-3636-4dd7-8f0f-de1fde07a726") : secret "samples-operator-tls" not found Sep 16 12:49:09.443701 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:09.443702 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls podName:6d40458f-6f54-4098-b0c4-11a5a069f6fc nodeName:}" failed. No retries permitted until 2026-09-16 12:49:13.443692606 +0000 UTC m=+76.502201494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qngjg" (UID: "6d40458f-6f54-4098-b0c4-11a5a069f6fc") : secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:09.543947 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:09.543913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:09.544142 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:09.544070 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 12:49:09.544142 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:09.544089 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c775b46-wls6m: secret "image-registry-tls" not found Sep 16 12:49:09.544265 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:09.544164 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls podName:91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:13.544142198 +0000 UTC m=+76.602651087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls") pod "image-registry-77c775b46-wls6m" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0") : secret "image-registry-tls" not found Sep 16 12:49:09.778529 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:09.778488 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2" event={"ID":"672bd470-9bc1-44f2-b42b-aa861ff950be","Type":"ContainerStarted","Data":"062c67270fcda6318431984b8aa5efb3af5903617a753e4c04b4847fa0a9d5ac"} Sep 16 12:49:09.796495 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:09.796446 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-968j2" podStartSLOduration=3.757228694 podStartE2EDuration="4.79642412s" totalImagesPullingTime="1.039195426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:09.79548629 +0000 UTC m=+72.853995199" watchObservedRunningTime="2026-09-16 12:49:09.79642412 +0000 UTC m=+72.854933029" Sep 16 12:49:10.783123 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:10.783082 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-28v7h" event={"ID":"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f","Type":"ContainerStarted","Data":"10d5d908fbabaf7ef164ad61e09575f3946ba304aaf08d01523fb521062b6e9d"} Sep 16 12:49:10.815304 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:10.815223 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-28v7h" podStartSLOduration=3.899672517 podStartE2EDuration="5.815207041s" totalImagesPullingTime="1.915534524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:10.813936569 +0000 UTC m=+73.872445477" watchObservedRunningTime="2026-09-16 12:49:10.815207041 +0000 UTC m=+73.873715949" Sep 16 12:49:12.635326 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.635296 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-52pvf"] Sep 16 12:49:12.637457 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.637424 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.642051 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.642026 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 16 12:49:12.642051 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.642042 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x6fmq\"" Sep 16 12:49:12.642420 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.642406 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 16 12:49:12.652146 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.652118 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-52pvf"] Sep 16 12:49:12.671881 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.671832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.672029 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.671899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zvst\" (UniqueName: \"kubernetes.io/projected/9117830d-0c23-4e22-9bc6-733fa9610397-kube-api-access-9zvst\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.672029 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.671938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9117830d-0c23-4e22-9bc6-733fa9610397-crio-socket\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.672029 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.671984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9117830d-0c23-4e22-9bc6-733fa9610397-data-volume\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.672173 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.672077 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.772688 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.772663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.772791 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.772691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zvst\" (UniqueName: \"kubernetes.io/projected/9117830d-0c23-4e22-9bc6-733fa9610397-kube-api-access-9zvst\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.772791 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.772714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9117830d-0c23-4e22-9bc6-733fa9610397-crio-socket\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.772791 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.772779 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9117830d-0c23-4e22-9bc6-733fa9610397-crio-socket\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.772920 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:12.772810 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 12:49:12.772920 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.772829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9117830d-0c23-4e22-9bc6-733fa9610397-data-volume\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.772920 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:12.772894 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:13.272873871 +0000 UTC m=+76.331382780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : secret "insights-runtime-extractor-tls" not found Sep 16 12:49:12.773052 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.772930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.773052 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:12.773032 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 12:49:12.773138 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:12.773088 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:13.273071597 +0000 UTC m=+76.331580508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : configmap "kube-rbac-proxy" not found Sep 16 12:49:12.773138 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.773074 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9117830d-0c23-4e22-9bc6-733fa9610397-data-volume\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:12.783689 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:12.783669 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zvst\" (UniqueName: \"kubernetes.io/projected/9117830d-0c23-4e22-9bc6-733fa9610397-kube-api-access-9zvst\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:13.276402 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.276364 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:13.276608 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.276437 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:13.276608 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.276503 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 12:49:13.276608 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.276534 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 12:49:13.276608 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.276584 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:14.276570676 +0000 UTC m=+77.335079563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : secret "insights-runtime-extractor-tls" not found Sep 16 12:49:13.276608 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.276600 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:14.276594539 +0000 UTC m=+77.335103426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : configmap "kube-rbac-proxy" not found Sep 16 12:49:13.417159 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.417085 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5"] Sep 16 12:49:13.419014 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.418992 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:13.422712 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.422688 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 16 12:49:13.422834 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.422688 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 16 12:49:13.422834 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.422783 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t76ld\"" Sep 16 12:49:13.435591 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.435571 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5"] Sep 16 12:49:13.478202 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.478178 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d7283f56-7b7f-4389-a6bf-50f42a89df26-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:13.478297 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.478205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:13.478345 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.478315 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:13.478388 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.478357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:13.478444 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.478432 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 16 12:49:13.478486 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.478454 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:13.478486 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.478479 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls podName:0432ce6c-3636-4dd7-8f0f-de1fde07a726 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:21.478466608 +0000 UTC m=+84.536975495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zslbq" (UID: "0432ce6c-3636-4dd7-8f0f-de1fde07a726") : secret "samples-operator-tls" not found Sep 16 12:49:13.478567 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.478495 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls podName:6d40458f-6f54-4098-b0c4-11a5a069f6fc nodeName:}" failed. No retries permitted until 2026-09-16 12:49:21.478484556 +0000 UTC m=+84.536993457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qngjg" (UID: "6d40458f-6f54-4098-b0c4-11a5a069f6fc") : secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:13.578895 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.578869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d7283f56-7b7f-4389-a6bf-50f42a89df26-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:13.579024 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.578898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:13.579024 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.579003 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 16 12:49:13.579136 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.579048 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert podName:d7283f56-7b7f-4389-a6bf-50f42a89df26 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:14.079032894 +0000 UTC m=+77.137541785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-lnmz5" (UID: "d7283f56-7b7f-4389-a6bf-50f42a89df26") : secret "networking-console-plugin-cert" not found Sep 16 12:49:13.579136 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.579094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:13.579249 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.579238 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 16 12:49:13.579298 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.579251 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c775b46-wls6m: secret "image-registry-tls" not found Sep 16 12:49:13.579352 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:13.579307 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls podName:91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:21.579292814 +0000 UTC m=+84.637801716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls") pod "image-registry-77c775b46-wls6m" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0") : secret "image-registry-tls" not found Sep 16 12:49:13.579604 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:13.579583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d7283f56-7b7f-4389-a6bf-50f42a89df26-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:14.083704 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:14.083669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:14.084117 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:14.083816 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 16 12:49:14.084117 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:14.083890 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert podName:d7283f56-7b7f-4389-a6bf-50f42a89df26 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:15.083875742 +0000 UTC m=+78.142384629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-lnmz5" (UID: "d7283f56-7b7f-4389-a6bf-50f42a89df26") : secret "networking-console-plugin-cert" not found Sep 16 12:49:14.285720 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:14.285681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:14.285917 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:14.285752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:14.285917 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:14.285822 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 12:49:14.285917 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:14.285863 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 12:49:14.285917 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:14.285908 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:16.28589059 +0000 UTC m=+79.344399491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : configmap "kube-rbac-proxy" not found Sep 16 12:49:14.286135 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:14.285928 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:16.28591878 +0000 UTC m=+79.344427666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : secret "insights-runtime-extractor-tls" not found Sep 16 12:49:15.092355 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:15.092311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:15.092738 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:15.092460 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 16 12:49:15.092738 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:15.092524 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert podName:d7283f56-7b7f-4389-a6bf-50f42a89df26 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:17.092506268 +0000 UTC m=+80.151015176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-lnmz5" (UID: "d7283f56-7b7f-4389-a6bf-50f42a89df26") : secret "networking-console-plugin-cert" not found Sep 16 12:49:15.589286 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:15.589260 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ssrrq_a69a0931-4858-4609-85df-062a0d799e1a/dns-node-resolver/0.log" Sep 16 12:49:16.300014 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:16.299986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:16.300374 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:16.300063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:16.300374 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:16.300130 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 12:49:16.300374 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:16.300159 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 12:49:16.300374 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:16.300202 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:20.300186253 +0000 UTC m=+83.358695144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : secret "insights-runtime-extractor-tls" not found Sep 16 12:49:16.300374 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:16.300216 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:20.300209866 +0000 UTC m=+83.358718753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : configmap "kube-rbac-proxy" not found Sep 16 12:49:16.389367 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:16.389344 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k942t_f2964d87-4632-4930-a87c-0cafa4154548/node-ca/0.log" Sep 16 12:49:16.991895 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:16.991867 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bg2ml_8713b81d-6d5f-4a95-8d12-71c32c6b8c30/serve-healthcheck-canary/0.log" Sep 16 12:49:17.108121 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:17.108083 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:17.108300 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:17.108240 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 16 12:49:17.108348 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:17.108307 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert podName:d7283f56-7b7f-4389-a6bf-50f42a89df26 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:21.108292059 +0000 UTC m=+84.166800962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-lnmz5" (UID: "d7283f56-7b7f-4389-a6bf-50f42a89df26") : secret "networking-console-plugin-cert" not found Sep 16 12:49:20.336348 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:20.336208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:20.336348 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:20.336333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:20.336806 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:20.336375 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 12:49:20.336806 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:20.336441 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:28.336427516 +0000 UTC m=+91.394936407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : secret "insights-runtime-extractor-tls" not found Sep 16 12:49:20.336806 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:20.336448 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 12:49:20.336806 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:20.336509 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm podName:9117830d-0c23-4e22-9bc6-733fa9610397 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:28.336495213 +0000 UTC m=+91.395004101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm") pod "insights-runtime-extractor-52pvf" (UID: "9117830d-0c23-4e22-9bc6-733fa9610397") : configmap "kube-rbac-proxy" not found Sep 16 12:49:21.143435 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:21.143386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:21.143614 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:21.143508 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 16 12:49:21.143614 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:21.143564 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert podName:d7283f56-7b7f-4389-a6bf-50f42a89df26 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:29.143549327 +0000 UTC m=+92.202058214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-lnmz5" (UID: "d7283f56-7b7f-4389-a6bf-50f42a89df26") : secret "networking-console-plugin-cert" not found Sep 16 12:49:21.546484 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:21.546401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:21.546484 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:21.546446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:21.546915 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:21.546541 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:21.546915 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:21.546591 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls podName:6d40458f-6f54-4098-b0c4-11a5a069f6fc nodeName:}" failed. No retries permitted until 2026-09-16 12:49:37.546578459 +0000 UTC m=+100.605087346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-qngjg" (UID: "6d40458f-6f54-4098-b0c4-11a5a069f6fc") : secret "cluster-monitoring-operator-tls" not found Sep 16 12:49:21.548703 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:21.548680 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0432ce6c-3636-4dd7-8f0f-de1fde07a726-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zslbq\" (UID: \"0432ce6c-3636-4dd7-8f0f-de1fde07a726\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:21.647626 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:21.647591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:21.649830 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:21.649810 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") pod \"image-registry-77c775b46-wls6m\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:21.665646 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:21.665626 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" Sep 16 12:49:21.761853 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:21.761814 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:21.936345 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:21.936309 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq"] Sep 16 12:49:22.034795 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:22.034766 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c775b46-wls6m"] Sep 16 12:49:22.038466 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:22.038436 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f88f9d_5fdc_4d6d_97d2_3edd6735a8d0.slice/crio-203c4cadba2028720d70ac984027ffbf3b77ad87eddefb37f2c69f9940680998 WatchSource:0}: Error finding container 203c4cadba2028720d70ac984027ffbf3b77ad87eddefb37f2c69f9940680998: Status 404 returned error can't find the container with id 203c4cadba2028720d70ac984027ffbf3b77ad87eddefb37f2c69f9940680998 Sep 16 12:49:22.815492 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:22.815448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c775b46-wls6m" event={"ID":"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0","Type":"ContainerStarted","Data":"4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63"} Sep 16 12:49:22.815973 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:22.815517 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c775b46-wls6m" event={"ID":"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0","Type":"ContainerStarted","Data":"203c4cadba2028720d70ac984027ffbf3b77ad87eddefb37f2c69f9940680998"} Sep 16 12:49:22.815973 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:22.815615 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:22.817022 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:22.816996 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" event={"ID":"0432ce6c-3636-4dd7-8f0f-de1fde07a726","Type":"ContainerStarted","Data":"6ad6bafe180fbf288a481da525efab367e811fc20ba7d52806bea4dc318e2626"} Sep 16 12:49:22.856184 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:22.856129 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77c775b46-wls6m" podStartSLOduration=17.856109154 podStartE2EDuration="17.856109154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:22.854716875 +0000 UTC m=+85.913225821" watchObservedRunningTime="2026-09-16 12:49:22.856109154 +0000 UTC m=+85.914618064" Sep 16 12:49:23.822917 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:23.822884 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" event={"ID":"0432ce6c-3636-4dd7-8f0f-de1fde07a726","Type":"ContainerStarted","Data":"a431156e481ab0b64ad1742a3119bc498b6837920410f85a7e7e4e5a336603ca"} Sep 16 12:49:23.823284 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:23.822941 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" event={"ID":"0432ce6c-3636-4dd7-8f0f-de1fde07a726","Type":"ContainerStarted","Data":"95a1f4d1e829f7e02bb5950d2763085b98d10ce06482e2d922a0d51e5ccb53ab"} Sep 16 12:49:23.843432 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:23.843388 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zslbq" podStartSLOduration=17.159292605 podStartE2EDuration="18.843370828s" totalImagesPullingTime="1.684078223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:23.843132958 +0000 UTC m=+86.901641881" watchObservedRunningTime="2026-09-16 12:49:23.843370828 +0000 UTC m=+86.901879736" Sep 16 12:49:28.401738 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:28.401699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:28.402131 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:28.401766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:28.402217 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:28.402195 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9117830d-0c23-4e22-9bc6-733fa9610397-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:28.403974 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:28.403959 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9117830d-0c23-4e22-9bc6-733fa9610397-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-52pvf\" (UID: \"9117830d-0c23-4e22-9bc6-733fa9610397\") " pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:28.546836 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:28.546805 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-52pvf" Sep 16 12:49:28.835795 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:28.835767 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-52pvf"] Sep 16 12:49:28.836342 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:28.836320 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9117830d_0c23_4e22_9bc6_733fa9610397.slice/crio-6f9422077c51ec7b5d4723c43c143db667d257e0ebaa5fdc5f04fd058a30c438 WatchSource:0}: Error finding container 6f9422077c51ec7b5d4723c43c143db667d257e0ebaa5fdc5f04fd058a30c438: Status 404 returned error can't find the container with id 6f9422077c51ec7b5d4723c43c143db667d257e0ebaa5fdc5f04fd058a30c438 Sep 16 12:49:28.840923 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:28.840895 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-52pvf" event={"ID":"9117830d-0c23-4e22-9bc6-733fa9610397","Type":"ContainerStarted","Data":"6f9422077c51ec7b5d4723c43c143db667d257e0ebaa5fdc5f04fd058a30c438"} Sep 16 12:49:29.208557 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:29.208477 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:29.210781 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:29.210757 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7283f56-7b7f-4389-a6bf-50f42a89df26-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-lnmz5\" (UID: \"d7283f56-7b7f-4389-a6bf-50f42a89df26\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:29.327961 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:29.327927 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" Sep 16 12:49:29.665924 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:29.665885 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5"] Sep 16 12:49:29.669560 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:29.669525 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7283f56_7b7f_4389_a6bf_50f42a89df26.slice/crio-33501fcb43b0c930c2cc8e6dea9490f08a4f42eace5fcbb4c82dc4d2aac66724 WatchSource:0}: Error finding container 33501fcb43b0c930c2cc8e6dea9490f08a4f42eace5fcbb4c82dc4d2aac66724: Status 404 returned error can't find the container with id 33501fcb43b0c930c2cc8e6dea9490f08a4f42eace5fcbb4c82dc4d2aac66724 Sep 16 12:49:29.845018 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:29.844987 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-52pvf" event={"ID":"9117830d-0c23-4e22-9bc6-733fa9610397","Type":"ContainerStarted","Data":"5a518289cf8e225fe2290c82e5462f155ca2e39cd864bc5a2d68a94ae89eb0d1"} Sep 16 12:49:29.845133 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:29.845046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-52pvf" event={"ID":"9117830d-0c23-4e22-9bc6-733fa9610397","Type":"ContainerStarted","Data":"335424098c2920afb7a64fe3d57f0623abdd10fafd61ea2a8ee365cee47d7447"} Sep 16 12:49:29.846024 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:29.845999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" event={"ID":"d7283f56-7b7f-4389-a6bf-50f42a89df26","Type":"ContainerStarted","Data":"33501fcb43b0c930c2cc8e6dea9490f08a4f42eace5fcbb4c82dc4d2aac66724"} Sep 16 12:49:31.857142 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:31.857108 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-52pvf" event={"ID":"9117830d-0c23-4e22-9bc6-733fa9610397","Type":"ContainerStarted","Data":"8c567486ca4eb54fa4271e40cd4466a39d148d56fd5d2bd0ff9c25859a8e2b14"} Sep 16 12:49:31.858654 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:31.858626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" event={"ID":"d7283f56-7b7f-4389-a6bf-50f42a89df26","Type":"ContainerStarted","Data":"028f179a02d6e92eb763622136b4fac31d4c5a79671f12368591423a07b41d25"} Sep 16 12:49:31.883714 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:31.883671 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-52pvf" podStartSLOduration=17.749323908 podStartE2EDuration="19.883656066s" totalImagesPullingTime="2.134332158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:49:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:31.882362525 +0000 UTC m=+94.940871434" watchObservedRunningTime="2026-09-16 12:49:31.883656066 +0000 UTC m=+94.942164977" Sep 16 12:49:31.912865 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:31.912812 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-lnmz5" podStartSLOduration=17.487843264 podStartE2EDuration="18.912797464s" totalImagesPullingTime="1.4249542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:31.912262063 +0000 UTC m=+94.970770973" watchObservedRunningTime="2026-09-16 12:49:31.912797464 +0000 UTC m=+94.971306374" Sep 16 12:49:36.771313 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:36.771253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:49:36.773604 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:36.773573 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a0054dc8-ac6f-4632-a637-68ba44d9aeae-metrics-tls\") pod \"dns-default-52rdp\" (UID: \"a0054dc8-ac6f-4632-a637-68ba44d9aeae\") " pod="openshift-dns/dns-default-52rdp" Sep 16 12:49:37.021828 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:37.021757 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sl6fp\"" Sep 16 12:49:37.030038 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:37.030019 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-52rdp" Sep 16 12:49:37.309074 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:37.309007 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-52rdp"] Sep 16 12:49:37.312077 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:37.312047 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0054dc8_ac6f_4632_a637_68ba44d9aeae.slice/crio-3fb2a8b8c6ea48e5609431a26a44ba887c07981566546ab7ed90af3eb71cb635 WatchSource:0}: Error finding container 3fb2a8b8c6ea48e5609431a26a44ba887c07981566546ab7ed90af3eb71cb635: Status 404 returned error can't find the container with id 3fb2a8b8c6ea48e5609431a26a44ba887c07981566546ab7ed90af3eb71cb635 Sep 16 12:49:37.577834 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:37.577804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:37.580232 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:37.580210 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d40458f-6f54-4098-b0c4-11a5a069f6fc-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-qngjg\" (UID: \"6d40458f-6f54-4098-b0c4-11a5a069f6fc\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:37.842476 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:37.842394 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" Sep 16 12:49:37.878870 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:37.878813 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-52rdp" event={"ID":"a0054dc8-ac6f-4632-a637-68ba44d9aeae","Type":"ContainerStarted","Data":"3fb2a8b8c6ea48e5609431a26a44ba887c07981566546ab7ed90af3eb71cb635"} Sep 16 12:49:38.117967 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:38.117895 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg"] Sep 16 12:49:38.121886 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:38.121828 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d40458f_6f54_4098_b0c4_11a5a069f6fc.slice/crio-a4ba71f6c7f3af4d25d025836301285dac100191b3fdd74cf9fea3323fd41a53 WatchSource:0}: Error finding container a4ba71f6c7f3af4d25d025836301285dac100191b3fdd74cf9fea3323fd41a53: Status 404 returned error can't find the container with id a4ba71f6c7f3af4d25d025836301285dac100191b3fdd74cf9fea3323fd41a53 Sep 16 12:49:38.884062 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:38.884037 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" event={"ID":"6d40458f-6f54-4098-b0c4-11a5a069f6fc","Type":"ContainerStarted","Data":"a4ba71f6c7f3af4d25d025836301285dac100191b3fdd74cf9fea3323fd41a53"} Sep 16 12:49:38.976133 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:38.976102 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c775b46-wls6m"] Sep 16 12:49:38.982187 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:38.982158 2580 patch_prober.go:28] interesting pod/image-registry-77c775b46-wls6m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 16 12:49:38.982300 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:38.982206 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77c775b46-wls6m" podUID="91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 12:49:39.111887 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.111796 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-558fd7566b-zjgxb"] Sep 16 12:49:39.115002 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.114975 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.133141 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.133115 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-558fd7566b-zjgxb"] Sep 16 12:49:39.290310 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.290274 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34276f03-0953-427a-852d-b59f2401c378-registry-certificates\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.290471 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.290318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34276f03-0953-427a-852d-b59f2401c378-trusted-ca\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.290471 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.290341 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34276f03-0953-427a-852d-b59f2401c378-installation-pull-secrets\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.290471 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.290399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34276f03-0953-427a-852d-b59f2401c378-image-registry-private-configuration\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.290471 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.290431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34276f03-0953-427a-852d-b59f2401c378-registry-tls\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.290471 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.290452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34276f03-0953-427a-852d-b59f2401c378-bound-sa-token\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.290685 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.290506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34276f03-0953-427a-852d-b59f2401c378-ca-trust-extracted\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.290685 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.290543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhjsx\" (UniqueName: \"kubernetes.io/projected/34276f03-0953-427a-852d-b59f2401c378-kube-api-access-bhjsx\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.391868 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.391779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34276f03-0953-427a-852d-b59f2401c378-ca-trust-extracted\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.391868 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.391822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhjsx\" (UniqueName: \"kubernetes.io/projected/34276f03-0953-427a-852d-b59f2401c378-kube-api-access-bhjsx\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.392081 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.391878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34276f03-0953-427a-852d-b59f2401c378-registry-certificates\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.392081 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.391901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34276f03-0953-427a-852d-b59f2401c378-trusted-ca\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.392081 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.391923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34276f03-0953-427a-852d-b59f2401c378-installation-pull-secrets\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.392267 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.392235 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34276f03-0953-427a-852d-b59f2401c378-ca-trust-extracted\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.392380 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.392293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34276f03-0953-427a-852d-b59f2401c378-image-registry-private-configuration\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.392380 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.392343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34276f03-0953-427a-852d-b59f2401c378-registry-tls\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.392380 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.392376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34276f03-0953-427a-852d-b59f2401c378-bound-sa-token\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.392775 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.392753 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34276f03-0953-427a-852d-b59f2401c378-registry-certificates\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.392902 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.392881 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34276f03-0953-427a-852d-b59f2401c378-trusted-ca\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.394993 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.394970 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34276f03-0953-427a-852d-b59f2401c378-installation-pull-secrets\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.395261 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.395240 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34276f03-0953-427a-852d-b59f2401c378-registry-tls\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.395364 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.395340 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34276f03-0953-427a-852d-b59f2401c378-image-registry-private-configuration\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.406839 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.406815 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhjsx\" (UniqueName: \"kubernetes.io/projected/34276f03-0953-427a-852d-b59f2401c378-kube-api-access-bhjsx\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.408572 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.408548 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34276f03-0953-427a-852d-b59f2401c378-bound-sa-token\") pod \"image-registry-558fd7566b-zjgxb\" (UID: \"34276f03-0953-427a-852d-b59f2401c378\") " pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.425143 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.425119 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:39.711660 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.711582 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-558fd7566b-zjgxb"] Sep 16 12:49:39.781963 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.781935 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qsbrp" Sep 16 12:49:39.890151 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.890081 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-52rdp" event={"ID":"a0054dc8-ac6f-4632-a637-68ba44d9aeae","Type":"ContainerStarted","Data":"c72fd3435e6a9206275fbfee69b7f2789ddc08c1f4358b43e33628ebd106b531"} Sep 16 12:49:39.890151 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.890144 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-52rdp" event={"ID":"a0054dc8-ac6f-4632-a637-68ba44d9aeae","Type":"ContainerStarted","Data":"4dc853ba5a9b888df76b2dc4b509f057f1d1c312b004683728c95bf5ac432b6f"} Sep 16 12:49:39.890631 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.890252 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-52rdp" Sep 16 12:49:39.910988 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:39.910931 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-52rdp" podStartSLOduration=66.389941915 podStartE2EDuration="1m7.910912678s" totalImagesPullingTime="1.520970763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:39.90983656 +0000 UTC m=+102.968345470" watchObservedRunningTime="2026-09-16 12:49:39.910912678 +0000 UTC m=+102.969421587" Sep 16 12:49:40.157038 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:40.157005 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34276f03_0953_427a_852d_b59f2401c378.slice/crio-0f1025c3975beaf5ae6a0c08fdffd2a141dfe373ed59b0dad5384eca48549f5c WatchSource:0}: Error finding container 0f1025c3975beaf5ae6a0c08fdffd2a141dfe373ed59b0dad5384eca48549f5c: Status 404 returned error can't find the container with id 0f1025c3975beaf5ae6a0c08fdffd2a141dfe373ed59b0dad5384eca48549f5c Sep 16 12:49:40.895504 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:40.895462 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" event={"ID":"6d40458f-6f54-4098-b0c4-11a5a069f6fc","Type":"ContainerStarted","Data":"51e490a84ab70f25da9881133ec4d97f8b8dabd48df534f3cc8acba57375070c"} Sep 16 12:49:40.897289 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:40.897262 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" event={"ID":"34276f03-0953-427a-852d-b59f2401c378","Type":"ContainerStarted","Data":"f1b1ac741102b2d9906a728de89a4ef809316745bbb717de67d594ddeb09931d"} Sep 16 12:49:40.897412 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:40.897304 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" event={"ID":"34276f03-0953-427a-852d-b59f2401c378","Type":"ContainerStarted","Data":"0f1025c3975beaf5ae6a0c08fdffd2a141dfe373ed59b0dad5384eca48549f5c"} Sep 16 12:49:40.897412 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:40.897346 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:49:40.912440 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:40.912391 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-qngjg" podStartSLOduration=33.499207719 podStartE2EDuration="35.912378125s" totalImagesPullingTime="2.413170406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:40.91172639 +0000 UTC m=+103.970235291" watchObservedRunningTime="2026-09-16 12:49:40.912378125 +0000 UTC m=+103.970887034" Sep 16 12:49:40.935254 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:40.935210 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" podStartSLOduration=1.935196222 podStartE2EDuration="1.935196222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:40.934193757 +0000 UTC m=+103.992702666" watchObservedRunningTime="2026-09-16 12:49:40.935196222 +0000 UTC m=+103.993705183" Sep 16 12:49:48.980613 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:48.980581 2580 patch_prober.go:28] interesting pod/image-registry-77c775b46-wls6m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 16 12:49:48.981087 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:48.980629 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77c775b46-wls6m" podUID="91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 12:49:49.899360 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:49.899331 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-52rdp" Sep 16 12:49:50.500514 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.500478 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k"] Sep 16 12:49:50.502531 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.502515 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.504268 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.504241 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cmf9s\"" Sep 16 12:49:50.504619 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.504604 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 16 12:49:50.504888 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.504873 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 16 12:49:50.504946 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.504898 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 16 12:49:50.515794 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.515772 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k"] Sep 16 12:49:50.554751 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.554723 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cvxpn"] Sep 16 12:49:50.556759 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.556742 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.558801 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.558782 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 16 12:49:50.559072 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.559059 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dd2m8\"" Sep 16 12:49:50.559290 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.559273 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 16 12:49:50.559357 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.559340 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 16 12:49:50.565441 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.565550 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gzrt\" (UniqueName: \"kubernetes.io/projected/b93070a0-0e10-4c49-bddb-5dfa61da4a46-kube-api-access-2gzrt\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.565550 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565523 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-tls\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.565550 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f7dfda8-2577-46fe-a846-af647fb9467d-metrics-client-ca\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.565677 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-wtmp\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.565677 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f7dfda8-2577-46fe-a846-af647fb9467d-sys\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.565677 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565671 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vwhv\" (UniqueName: \"kubernetes.io/projected/8f7dfda8-2577-46fe-a846-af647fb9467d-kube-api-access-4vwhv\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.565789 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-textfile\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.565789 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-accelerators-collector-config\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.565789 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b93070a0-0e10-4c49-bddb-5dfa61da4a46-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.565942 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b93070a0-0e10-4c49-bddb-5dfa61da4a46-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.565942 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b93070a0-0e10-4c49-bddb-5dfa61da4a46-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.565942 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.565903 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f7dfda8-2577-46fe-a846-af647fb9467d-root\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.666860 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.666819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f7dfda8-2577-46fe-a846-af647fb9467d-sys\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667037 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.666872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vwhv\" (UniqueName: \"kubernetes.io/projected/8f7dfda8-2577-46fe-a846-af647fb9467d-kube-api-access-4vwhv\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667037 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.666907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-textfile\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667037 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.666925 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-accelerators-collector-config\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667037 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.666929 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f7dfda8-2577-46fe-a846-af647fb9467d-sys\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667037 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.666945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b93070a0-0e10-4c49-bddb-5dfa61da4a46-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.667037 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.666963 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b93070a0-0e10-4c49-bddb-5dfa61da4a46-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.667331 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b93070a0-0e10-4c49-bddb-5dfa61da4a46-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.667331 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667142 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f7dfda8-2577-46fe-a846-af647fb9467d-root\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667331 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667176 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667331 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667262 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gzrt\" (UniqueName: \"kubernetes.io/projected/b93070a0-0e10-4c49-bddb-5dfa61da4a46-kube-api-access-2gzrt\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.667331 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:50.667263 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 16 12:49:50.667331 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-tls\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667614 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667326 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f7dfda8-2577-46fe-a846-af647fb9467d-root\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667614 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:50.667355 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93070a0-0e10-4c49-bddb-5dfa61da4a46-openshift-state-metrics-tls podName:b93070a0-0e10-4c49-bddb-5dfa61da4a46 nodeName:}" failed. No retries permitted until 2026-09-16 12:49:51.167330695 +0000 UTC m=+114.225839600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b93070a0-0e10-4c49-bddb-5dfa61da4a46-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-ffx9k" (UID: "b93070a0-0e10-4c49-bddb-5dfa61da4a46") : secret "openshift-state-metrics-tls" not found Sep 16 12:49:50.667614 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:50.667413 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 16 12:49:50.667614 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667272 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-textfile\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667614 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:49:50.667504 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-tls podName:8f7dfda8-2577-46fe-a846-af647fb9467d nodeName:}" failed. No retries permitted until 2026-09-16 12:49:51.167485856 +0000 UTC m=+114.225994744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-tls") pod "node-exporter-cvxpn" (UID: "8f7dfda8-2577-46fe-a846-af647fb9467d") : secret "node-exporter-tls" not found Sep 16 12:49:50.667614 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f7dfda8-2577-46fe-a846-af647fb9467d-metrics-client-ca\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667614 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-wtmp\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.667614 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667566 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-accelerators-collector-config\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.668081 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667677 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b93070a0-0e10-4c49-bddb-5dfa61da4a46-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.668081 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.667740 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-wtmp\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.668170 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.668101 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f7dfda8-2577-46fe-a846-af647fb9467d-metrics-client-ca\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.669480 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.669460 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:50.669704 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.669682 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b93070a0-0e10-4c49-bddb-5dfa61da4a46-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.675427 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.675403 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gzrt\" (UniqueName: \"kubernetes.io/projected/b93070a0-0e10-4c49-bddb-5dfa61da4a46-kube-api-access-2gzrt\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:50.675685 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:50.675659 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vwhv\" (UniqueName: \"kubernetes.io/projected/8f7dfda8-2577-46fe-a846-af647fb9467d-kube-api-access-4vwhv\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:51.171985 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.171943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-tls\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:51.172247 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.172007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b93070a0-0e10-4c49-bddb-5dfa61da4a46-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:51.174352 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.174324 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f7dfda8-2577-46fe-a846-af647fb9467d-node-exporter-tls\") pod \"node-exporter-cvxpn\" (UID: \"8f7dfda8-2577-46fe-a846-af647fb9467d\") " pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:51.174451 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.174423 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b93070a0-0e10-4c49-bddb-5dfa61da4a46-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-ffx9k\" (UID: \"b93070a0-0e10-4c49-bddb-5dfa61da4a46\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:51.414966 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.414939 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" Sep 16 12:49:51.466155 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.466064 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cvxpn" Sep 16 12:49:51.476311 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:51.476279 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7dfda8_2577_46fe_a846_af647fb9467d.slice/crio-da17a54f3eb32223227fa45c45bac2dc7072a919582aae80a3835705db0d3ae0 WatchSource:0}: Error finding container da17a54f3eb32223227fa45c45bac2dc7072a919582aae80a3835705db0d3ae0: Status 404 returned error can't find the container with id da17a54f3eb32223227fa45c45bac2dc7072a919582aae80a3835705db0d3ae0 Sep 16 12:49:51.686866 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.686780 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k"] Sep 16 12:49:51.690923 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:51.690888 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93070a0_0e10_4c49_bddb_5dfa61da4a46.slice/crio-5955eb0efce3e676f997daaf68b4810df968324e5af330a6fdaa28eead57e308 WatchSource:0}: Error finding container 5955eb0efce3e676f997daaf68b4810df968324e5af330a6fdaa28eead57e308: Status 404 returned error can't find the container with id 5955eb0efce3e676f997daaf68b4810df968324e5af330a6fdaa28eead57e308 Sep 16 12:49:51.935554 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.935518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cvxpn" event={"ID":"8f7dfda8-2577-46fe-a846-af647fb9467d","Type":"ContainerStarted","Data":"da17a54f3eb32223227fa45c45bac2dc7072a919582aae80a3835705db0d3ae0"} Sep 16 12:49:51.937840 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.937756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" event={"ID":"b93070a0-0e10-4c49-bddb-5dfa61da4a46","Type":"ContainerStarted","Data":"fa48d2034f271b27771dbfcaabef2fe2c98ca05fa9001e72a4f3d0146e0e051d"} Sep 16 12:49:51.937840 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.937821 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" event={"ID":"b93070a0-0e10-4c49-bddb-5dfa61da4a46","Type":"ContainerStarted","Data":"14f8dab92a6e92e1d798f62103f6de85ebfee40837046eabb450fcb7ee7a00bf"} Sep 16 12:49:51.938045 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:51.937861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" event={"ID":"b93070a0-0e10-4c49-bddb-5dfa61da4a46","Type":"ContainerStarted","Data":"5955eb0efce3e676f997daaf68b4810df968324e5af330a6fdaa28eead57e308"} Sep 16 12:49:52.943503 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:52.943432 2580 generic.go:356] "Generic (PLEG): container finished" podID="8f7dfda8-2577-46fe-a846-af647fb9467d" containerID="2b779d5ecb86c76814fedee6b9da3b3c2e813a36b170935d2b29fa9d58e26c30" exitCode=0 Sep 16 12:49:52.943875 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:52.943511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cvxpn" event={"ID":"8f7dfda8-2577-46fe-a846-af647fb9467d","Type":"ContainerDied","Data":"2b779d5ecb86c76814fedee6b9da3b3c2e813a36b170935d2b29fa9d58e26c30"} Sep 16 12:49:52.945979 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:52.945954 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" event={"ID":"b93070a0-0e10-4c49-bddb-5dfa61da4a46","Type":"ContainerStarted","Data":"08a81c760984e35721de4197471dda47ff73a406585aefc5ae85f97bcef5c97e"} Sep 16 12:49:52.975132 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:52.975087 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-ffx9k" podStartSLOduration=1.993845645 podStartE2EDuration="2.975072788s" totalImagesPullingTime="981.227143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:52.97401237 +0000 UTC m=+116.032521280" watchObservedRunningTime="2026-09-16 12:49:52.975072788 +0000 UTC m=+116.033581697" Sep 16 12:49:53.519749 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.519711 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5779b857d6-btqhk"] Sep 16 12:49:53.522135 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.522114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.528383 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.528358 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7kc9vglhqt856\"" Sep 16 12:49:53.528383 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.528371 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 16 12:49:53.528535 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.528368 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 16 12:49:53.528964 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.528949 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 16 12:49:53.529024 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.529009 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 16 12:49:53.529069 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.529009 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5vsxd\"" Sep 16 12:49:53.529610 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.529593 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 16 12:49:53.545817 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.545792 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5779b857d6-btqhk"] Sep 16 12:49:53.591353 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.591329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/692d29f3-089f-493f-8094-1b750dd1fa82-metrics-client-ca\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.591445 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.591369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.591498 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.591430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.591534 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.591510 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.591568 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.591535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hw5t\" (UniqueName: \"kubernetes.io/projected/692d29f3-089f-493f-8094-1b750dd1fa82-kube-api-access-4hw5t\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.591568 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.591552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-grpc-tls\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.591632 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.591611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.591665 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.591629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-tls\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.692051 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.692024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.692151 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.692055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hw5t\" (UniqueName: \"kubernetes.io/projected/692d29f3-089f-493f-8094-1b750dd1fa82-kube-api-access-4hw5t\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.692151 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.692072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-grpc-tls\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.692151 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.692129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.692263 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.692169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-tls\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.692263 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.692219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/692d29f3-089f-493f-8094-1b750dd1fa82-metrics-client-ca\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.692263 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.692251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.692402 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.692286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.693087 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.693058 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/692d29f3-089f-493f-8094-1b750dd1fa82-metrics-client-ca\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.694684 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.694662 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.694782 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.694761 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.694990 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.694968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.695111 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.695096 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-tls\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.695211 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.695193 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.695308 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.695288 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/692d29f3-089f-493f-8094-1b750dd1fa82-secret-grpc-tls\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.699520 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.699500 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hw5t\" (UniqueName: \"kubernetes.io/projected/692d29f3-089f-493f-8094-1b750dd1fa82-kube-api-access-4hw5t\") pod \"thanos-querier-5779b857d6-btqhk\" (UID: \"692d29f3-089f-493f-8094-1b750dd1fa82\") " pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.831058 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.831036 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:53.951733 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.951694 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cvxpn" event={"ID":"8f7dfda8-2577-46fe-a846-af647fb9467d","Type":"ContainerStarted","Data":"d9a2e06e4496f0204f449911d70e76487af5feca729e4a55ea5b19b947e3614b"} Sep 16 12:49:53.952070 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.951758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cvxpn" event={"ID":"8f7dfda8-2577-46fe-a846-af647fb9467d","Type":"ContainerStarted","Data":"0bc498fdfe0decda7abb0b7606ba2762ef942857ed798376e6cb92c2d7c5fa2c"} Sep 16 12:49:53.971137 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:53.971094 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cvxpn" podStartSLOduration=3.102450588 podStartE2EDuration="3.97107789s" totalImagesPullingTime="796.863727ms" totalInitContainerRuntime="71.763575ms" isStatefulPod=true podCreationTimestamp="2026-09-16 12:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:53.969706598 +0000 UTC m=+117.028215513" watchObservedRunningTime="2026-09-16 12:49:53.97107789 +0000 UTC m=+117.029586799" Sep 16 12:49:54.101735 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:54.101641 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5779b857d6-btqhk"] Sep 16 12:49:54.104169 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:54.104141 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692d29f3_089f_493f_8094_1b750dd1fa82.slice/crio-bae06fecb085f1684cbe15d87bc35be75de31e7e4871cde525003492880a74d5 WatchSource:0}: Error finding container bae06fecb085f1684cbe15d87bc35be75de31e7e4871cde525003492880a74d5: Status 404 returned error can't find the container with id bae06fecb085f1684cbe15d87bc35be75de31e7e4871cde525003492880a74d5 Sep 16 12:49:54.957547 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:54.957501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" event={"ID":"692d29f3-089f-493f-8094-1b750dd1fa82","Type":"ContainerStarted","Data":"bae06fecb085f1684cbe15d87bc35be75de31e7e4871cde525003492880a74d5"} Sep 16 12:49:55.962549 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:55.962521 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" event={"ID":"692d29f3-089f-493f-8094-1b750dd1fa82","Type":"ContainerStarted","Data":"686bc262c3be3c690b3d2716f17b1120fa70e78ca2dfbb97e5f451be8fc80670"} Sep 16 12:49:56.701898 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.701863 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 12:49:56.705669 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.705648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.709636 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.709613 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 16 12:49:56.710111 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.710082 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 16 12:49:56.710936 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.710715 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 16 12:49:56.710936 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.710724 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rvc4c\"" Sep 16 12:49:56.710936 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.710808 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 16 12:49:56.710936 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.710817 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 16 12:49:56.711270 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.711251 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 16 12:49:56.711348 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.711284 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 16 12:49:56.711348 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.711257 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 16 12:49:56.711562 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.711535 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 16 12:49:56.711562 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.711554 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 16 12:49:56.711687 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.711569 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 16 12:49:56.711687 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.711640 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 16 12:49:56.712156 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.712135 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 16 12:49:56.712484 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.712462 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 16 12:49:56.712832 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.712814 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7a7tuo9dkj6oh\"" Sep 16 12:49:56.714625 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.714295 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 16 12:49:56.728000 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.727973 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 12:49:56.819734 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.819701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.819734 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.819740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.819992 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.819766 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.819992 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.819796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-config\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.819992 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.819879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.819992 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.819913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.819992 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.819932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.819992 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.819952 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.819992 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.819975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-web-config\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5892543e-ca0f-48dd-b569-d0e13354c27b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820219 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5892543e-ca0f-48dd-b569-d0e13354c27b-config-out\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820294 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.820347 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.820340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxgh6\" (UniqueName: \"kubernetes.io/projected/5892543e-ca0f-48dd-b569-d0e13354c27b-kube-api-access-gxgh6\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921624 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921624 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-config\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921825 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921825 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921825 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921825 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921825 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921825 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921825 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-web-config\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.921825 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5892543e-ca0f-48dd-b569-d0e13354c27b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921925 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.921985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5892543e-ca0f-48dd-b569-d0e13354c27b-config-out\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.922013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.922042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.922092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxgh6\" (UniqueName: \"kubernetes.io/projected/5892543e-ca0f-48dd-b569-d0e13354c27b-kube-api-access-gxgh6\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.922144 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922241 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.922183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922708 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.922415 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.922708 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.922493 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.923175 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.922840 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.925247 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.924719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-config\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.925247 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.924868 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.925247 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.924946 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.925442 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.925294 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.927137 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.925567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.927137 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.925915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.927137 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.926401 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.927137 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.926411 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.927137 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.927090 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.927465 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.927367 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.928273 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.927978 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5892543e-ca0f-48dd-b569-d0e13354c27b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.928273 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.928171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.928273 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.928208 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.928273 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.928206 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5892543e-ca0f-48dd-b569-d0e13354c27b-web-config\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.928569 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.928487 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5892543e-ca0f-48dd-b569-d0e13354c27b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.929180 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.929158 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5892543e-ca0f-48dd-b569-d0e13354c27b-config-out\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.934401 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.934375 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxgh6\" (UniqueName: \"kubernetes.io/projected/5892543e-ca0f-48dd-b569-d0e13354c27b-kube-api-access-gxgh6\") pod \"prometheus-k8s-0\" (UID: \"5892543e-ca0f-48dd-b569-d0e13354c27b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:56.968599 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.968574 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" event={"ID":"692d29f3-089f-493f-8094-1b750dd1fa82","Type":"ContainerStarted","Data":"626ce2b865a4f93cfb47d818b390963ead8c85c4d047f8f5b9425dfc89f24131"} Sep 16 12:49:56.968881 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:56.968650 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" event={"ID":"692d29f3-089f-493f-8094-1b750dd1fa82","Type":"ContainerStarted","Data":"dc8c03e52d9efeaac95f6af2aa4ca94a0ef5c48887dc64687f8b5e5e8f28db28"} Sep 16 12:49:57.017632 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:57.017604 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:49:57.301515 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:57.301442 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 12:49:57.305137 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:49:57.305104 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5892543e_ca0f_48dd_b569_d0e13354c27b.slice/crio-6f32c87934a6b4e9dc0df46994ec3b3710d8992a973ddbd74c8c2014c0ee14e3 WatchSource:0}: Error finding container 6f32c87934a6b4e9dc0df46994ec3b3710d8992a973ddbd74c8c2014c0ee14e3: Status 404 returned error can't find the container with id 6f32c87934a6b4e9dc0df46994ec3b3710d8992a973ddbd74c8c2014c0ee14e3 Sep 16 12:49:57.975598 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:57.975555 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" event={"ID":"692d29f3-089f-493f-8094-1b750dd1fa82","Type":"ContainerStarted","Data":"fbba9a6540f16fcc57a178e6d92e52a189dc83718890dc5f05225407027ecee7"} Sep 16 12:49:57.976139 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:57.975632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" event={"ID":"692d29f3-089f-493f-8094-1b750dd1fa82","Type":"ContainerStarted","Data":"ecaed70f3a3fd977af134b40289522bc71a201bbbe503eeac26f632f60758810"} Sep 16 12:49:57.976139 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:57.975670 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" event={"ID":"692d29f3-089f-493f-8094-1b750dd1fa82","Type":"ContainerStarted","Data":"2092fefc3e35fb484fa10e74e560c262d9b13dd4b8c65ee1d73a4cb93ef77598"} Sep 16 12:49:57.976139 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:57.975705 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:49:57.976917 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:57.976895 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5892543e-ca0f-48dd-b569-d0e13354c27b","Type":"ContainerStarted","Data":"6f32c87934a6b4e9dc0df46994ec3b3710d8992a973ddbd74c8c2014c0ee14e3"} Sep 16 12:49:58.010114 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:58.010071 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" podStartSLOduration=2.352368396 podStartE2EDuration="5.010057329s" totalImagesPullingTime="2.657688933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:58.009302405 +0000 UTC m=+121.067811318" watchObservedRunningTime="2026-09-16 12:49:58.010057329 +0000 UTC m=+121.068566238" Sep 16 12:49:58.981358 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:58.981329 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:49:58.982281 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:58.982246 2580 generic.go:356] "Generic (PLEG): container finished" podID="5892543e-ca0f-48dd-b569-d0e13354c27b" containerID="61d88520dda17be9ed7ce114f5b2f6260179641774267395377b9c72359b86ec" exitCode=0 Sep 16 12:49:58.982413 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:49:58.982327 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5892543e-ca0f-48dd-b569-d0e13354c27b","Type":"ContainerDied","Data":"61d88520dda17be9ed7ce114f5b2f6260179641774267395377b9c72359b86ec"} Sep 16 12:50:01.905410 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:01.905386 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-558fd7566b-zjgxb" Sep 16 12:50:01.996578 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:01.996540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5892543e-ca0f-48dd-b569-d0e13354c27b","Type":"ContainerStarted","Data":"145b318c7a836c1e53b303c36181c4545e201558f847cda26d500841bd3153e6"} Sep 16 12:50:01.996704 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:01.996635 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5892543e-ca0f-48dd-b569-d0e13354c27b","Type":"ContainerStarted","Data":"77ad44033f428b25e855e1f16d6c0ea041090d7e69712ffca9ad328704bc8c96"} Sep 16 12:50:03.006562 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:03.006526 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5892543e-ca0f-48dd-b569-d0e13354c27b","Type":"ContainerStarted","Data":"6fcbebee35403a62d710a7e698e55b47267fb8f7f56d2e71b97db1ee8162fa52"} Sep 16 12:50:03.006951 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:03.006625 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5892543e-ca0f-48dd-b569-d0e13354c27b","Type":"ContainerStarted","Data":"3f60b53bc8ae233370376c51d70848bc92c0337ce2bef7fac673e77a55ccbddf"} Sep 16 12:50:03.006951 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:03.006651 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5892543e-ca0f-48dd-b569-d0e13354c27b","Type":"ContainerStarted","Data":"fb9b3d293429c65183211f3ebb339aada10ae35678dd82c58c09c89464078e30"} Sep 16 12:50:03.006951 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:03.006676 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5892543e-ca0f-48dd-b569-d0e13354c27b","Type":"ContainerStarted","Data":"a93f3e105a2291415bb893772bc12e8b16527c598814bd0fcd3dc64b2435b576"} Sep 16 12:50:03.038576 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:03.038525 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.943937028 podStartE2EDuration="7.038506872s" totalImagesPullingTime="4.077370636s" totalInitContainerRuntime="17.199208ms" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:50:03.036418921 +0000 UTC m=+126.094927831" watchObservedRunningTime="2026-09-16 12:50:03.038506872 +0000 UTC m=+126.097015820" Sep 16 12:50:03.988699 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:03.988672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5779b857d6-btqhk" Sep 16 12:50:04.002286 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.002256 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77c775b46-wls6m" podUID="91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" containerName="registry" containerID="cri-o://4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63" gracePeriod=30 Sep 16 12:50:04.252302 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.252228 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:50:04.296656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.295931 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-certificates\") pod \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " Sep 16 12:50:04.296656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.295986 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvbkm\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-kube-api-access-jvbkm\") pod \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " Sep 16 12:50:04.296656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.296015 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-bound-sa-token\") pod \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " Sep 16 12:50:04.296656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.296063 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-trusted-ca\") pod \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " Sep 16 12:50:04.296656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.296094 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-image-registry-private-configuration\") pod \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " Sep 16 12:50:04.296656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.296122 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-installation-pull-secrets\") pod \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " Sep 16 12:50:04.296656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.296160 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-ca-trust-extracted\") pod \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " Sep 16 12:50:04.296656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.296232 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") pod \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\" (UID: \"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0\") " Sep 16 12:50:04.296656 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.296316 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 12:50:04.297217 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.296776 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 12:50:04.298908 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.298875 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-certificates\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 12:50:04.299770 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.299523 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 12:50:04.299900 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.299878 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-kube-api-access-jvbkm" (OuterVolumeSpecName: "kube-api-access-jvbkm") pod "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0"). InnerVolumeSpecName "kube-api-access-jvbkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 12:50:04.300041 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.300012 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 12:50:04.300117 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.300083 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 12:50:04.300312 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.300291 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 12:50:04.308782 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.308756 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" (UID: "91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 12:50:04.399976 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.399949 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvbkm\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-kube-api-access-jvbkm\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 12:50:04.399976 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.399973 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-bound-sa-token\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 12:50:04.399976 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.399983 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-trusted-ca\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 12:50:04.400174 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.399991 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-image-registry-private-configuration\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 12:50:04.400174 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.400001 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-installation-pull-secrets\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 12:50:04.400174 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.400009 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-ca-trust-extracted\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 12:50:04.400174 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:04.400017 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0-registry-tls\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 12:50:05.015123 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.015091 2580 generic.go:356] "Generic (PLEG): container finished" podID="91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" containerID="4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63" exitCode=0 Sep 16 12:50:05.015279 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.015141 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c775b46-wls6m" Sep 16 12:50:05.015279 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.015161 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c775b46-wls6m" event={"ID":"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0","Type":"ContainerDied","Data":"4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63"} Sep 16 12:50:05.015279 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.015198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c775b46-wls6m" event={"ID":"91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0","Type":"ContainerDied","Data":"203c4cadba2028720d70ac984027ffbf3b77ad87eddefb37f2c69f9940680998"} Sep 16 12:50:05.015279 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.015221 2580 scope.go:117] "RemoveContainer" containerID="4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63" Sep 16 12:50:05.024119 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.024102 2580 scope.go:117] "RemoveContainer" containerID="4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63" Sep 16 12:50:05.024423 ip-10-0-137-26 kubenswrapper[2580]: E0916 12:50:05.024403 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63\": container with ID starting with 4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63 not found: ID does not exist" containerID="4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63" Sep 16 12:50:05.024486 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.024437 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63"} err="failed to get container status \"4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63\": rpc error: code = NotFound desc = could not find container \"4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63\": container with ID starting with 4e31189e3d4f645939367d0e63017b0b1bc8690ccd7d7cde7289ddbf38b07e63 not found: ID does not exist" Sep 16 12:50:05.043215 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.040348 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c775b46-wls6m"] Sep 16 12:50:05.045032 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.045010 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77c775b46-wls6m"] Sep 16 12:50:05.402300 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:05.402269 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" path="/var/lib/kubelet/pods/91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0/volumes" Sep 16 12:50:07.017745 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:07.017706 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:50:07.221255 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:07.221202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:50:07.223538 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:07.223506 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41775133-5324-474c-9c12-645b149e7113-metrics-certs\") pod \"network-metrics-daemon-ltwsm\" (UID: \"41775133-5324-474c-9c12-645b149e7113\") " pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:50:07.314472 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:07.314387 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27x5j\"" Sep 16 12:50:07.322329 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:07.322301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltwsm" Sep 16 12:50:07.596944 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:07.596753 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ltwsm"] Sep 16 12:50:07.599515 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:50:07.599486 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41775133_5324_474c_9c12_645b149e7113.slice/crio-3e45e88d0705ba15cee37de9e7927b779ccfb1c8c5c35b4f37d6bf9eb83fd1bb WatchSource:0}: Error finding container 3e45e88d0705ba15cee37de9e7927b779ccfb1c8c5c35b4f37d6bf9eb83fd1bb: Status 404 returned error can't find the container with id 3e45e88d0705ba15cee37de9e7927b779ccfb1c8c5c35b4f37d6bf9eb83fd1bb Sep 16 12:50:08.027769 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:08.027683 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ltwsm" event={"ID":"41775133-5324-474c-9c12-645b149e7113","Type":"ContainerStarted","Data":"3e45e88d0705ba15cee37de9e7927b779ccfb1c8c5c35b4f37d6bf9eb83fd1bb"} Sep 16 12:50:09.033827 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:09.033745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ltwsm" event={"ID":"41775133-5324-474c-9c12-645b149e7113","Type":"ContainerStarted","Data":"06beedfe674cbb382cdfed29a7779f29a21099b14d18c2d93bcd66a64d815ed3"} Sep 16 12:50:09.033827 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:09.033822 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ltwsm" event={"ID":"41775133-5324-474c-9c12-645b149e7113","Type":"ContainerStarted","Data":"c920b8df5b2cd8d8757871d78257de8182e34ff371bcbd3d97b6866a1316e653"} Sep 16 12:50:09.053891 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:09.053830 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ltwsm" podStartSLOduration=129.90352735 podStartE2EDuration="2m11.053815991s" totalImagesPullingTime="1.150288641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:50:09.052791975 +0000 UTC m=+132.111300885" watchObservedRunningTime="2026-09-16 12:50:09.053815991 +0000 UTC m=+132.112324900" Sep 16 12:50:27.102523 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:27.102487 2580 generic.go:356] "Generic (PLEG): container finished" podID="1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f" containerID="10d5d908fbabaf7ef164ad61e09575f3946ba304aaf08d01523fb521062b6e9d" exitCode=0 Sep 16 12:50:27.102950 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:27.102565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-28v7h" event={"ID":"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f","Type":"ContainerDied","Data":"10d5d908fbabaf7ef164ad61e09575f3946ba304aaf08d01523fb521062b6e9d"} Sep 16 12:50:27.103009 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:27.102947 2580 scope.go:117] "RemoveContainer" containerID="10d5d908fbabaf7ef164ad61e09575f3946ba304aaf08d01523fb521062b6e9d" Sep 16 12:50:28.108286 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:28.108254 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-28v7h" event={"ID":"1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f","Type":"ContainerStarted","Data":"9c9c0d07bbb058a92a384c631b937ab203f59f2ffa006f6b16bdfb36b327f42f"} Sep 16 12:50:57.018462 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:57.018371 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:50:57.037931 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:57.037906 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:50:57.235898 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:50:57.235869 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 12:52:57.328234 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:52:57.328206 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 16 12:59:13.911508 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.911475 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf"] Sep 16 12:59:13.912004 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.911829 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" containerName="registry" Sep 16 12:59:13.912004 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.911855 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" containerName="registry" Sep 16 12:59:13.912004 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.911922 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f88f9d-5fdc-4d6d-97d2-3edd6735a8d0" containerName="registry" Sep 16 12:59:13.914781 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.914766 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 12:59:13.917583 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.917563 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 16 12:59:13.917976 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.917751 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-4wttx\"" Sep 16 12:59:13.919282 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.919266 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Sep 16 12:59:13.919337 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.919288 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 16 12:59:13.926056 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:13.926034 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf"] Sep 16 12:59:14.016018 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:14.015986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lpk\" (UniqueName: \"kubernetes.io/projected/36ff74f6-afcf-41cd-8e2a-8eb4009e4957-kube-api-access-b2lpk\") pod \"llmisvc-controller-manager-645f9c8fd6-v8hnf\" (UID: \"36ff74f6-afcf-41cd-8e2a-8eb4009e4957\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 12:59:14.016166 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:14.016068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36ff74f6-afcf-41cd-8e2a-8eb4009e4957-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-v8hnf\" (UID: \"36ff74f6-afcf-41cd-8e2a-8eb4009e4957\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 12:59:14.116778 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:14.116749 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lpk\" (UniqueName: \"kubernetes.io/projected/36ff74f6-afcf-41cd-8e2a-8eb4009e4957-kube-api-access-b2lpk\") pod \"llmisvc-controller-manager-645f9c8fd6-v8hnf\" (UID: \"36ff74f6-afcf-41cd-8e2a-8eb4009e4957\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 12:59:14.116933 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:14.116804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36ff74f6-afcf-41cd-8e2a-8eb4009e4957-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-v8hnf\" (UID: \"36ff74f6-afcf-41cd-8e2a-8eb4009e4957\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 12:59:14.119203 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:14.119173 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36ff74f6-afcf-41cd-8e2a-8eb4009e4957-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-v8hnf\" (UID: \"36ff74f6-afcf-41cd-8e2a-8eb4009e4957\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 12:59:14.128473 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:14.128444 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lpk\" (UniqueName: \"kubernetes.io/projected/36ff74f6-afcf-41cd-8e2a-8eb4009e4957-kube-api-access-b2lpk\") pod \"llmisvc-controller-manager-645f9c8fd6-v8hnf\" (UID: \"36ff74f6-afcf-41cd-8e2a-8eb4009e4957\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 12:59:14.224026 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:14.223974 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 12:59:14.510334 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:14.510117 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf"] Sep 16 12:59:14.513115 ip-10-0-137-26 kubenswrapper[2580]: W0916 12:59:14.513089 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36ff74f6_afcf_41cd_8e2a_8eb4009e4957.slice/crio-cd26d3cbbac70f86dcd7670db22d8e179efa67f8f9f41ae170bd686ad3cc7f39 WatchSource:0}: Error finding container cd26d3cbbac70f86dcd7670db22d8e179efa67f8f9f41ae170bd686ad3cc7f39: Status 404 returned error can't find the container with id cd26d3cbbac70f86dcd7670db22d8e179efa67f8f9f41ae170bd686ad3cc7f39 Sep 16 12:59:14.514862 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:14.514833 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 12:59:15.044062 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:15.044020 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" event={"ID":"36ff74f6-afcf-41cd-8e2a-8eb4009e4957","Type":"ContainerStarted","Data":"cd26d3cbbac70f86dcd7670db22d8e179efa67f8f9f41ae170bd686ad3cc7f39"} Sep 16 12:59:17.052793 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:17.052761 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" event={"ID":"36ff74f6-afcf-41cd-8e2a-8eb4009e4957","Type":"ContainerStarted","Data":"3e150a9430ca061c0313362befa1513450db2eae1456dae6ad12d54698bc6b56"} Sep 16 12:59:17.053156 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:17.052890 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 12:59:17.097989 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:17.097943 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" podStartSLOduration=1.695927104 podStartE2EDuration="4.097927744s" totalImagesPullingTime="2.40200064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:59:17.09681462 +0000 UTC m=+680.155323531" watchObservedRunningTime="2026-09-16 12:59:17.097927744 +0000 UTC m=+680.156436653" Sep 16 12:59:48.059373 ip-10-0-137-26 kubenswrapper[2580]: I0916 12:59:48.059344 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-v8hnf" Sep 16 13:00:50.790394 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:50.790356 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-rp6cg"] Sep 16 13:00:50.793599 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:50.793581 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-rp6cg" Sep 16 13:00:50.798232 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:50.798212 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-dt9dl\"" Sep 16 13:00:50.798323 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:50.798225 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 16 13:00:50.798618 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:50.798603 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 16 13:00:50.807762 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:50.807739 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-rp6cg"] Sep 16 13:00:50.912885 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:50.912824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0154786f-7288-4406-adb3-adceab91cbe8-model-cache\") pod \"s3-init-rp6cg\" (UID: \"0154786f-7288-4406-adb3-adceab91cbe8\") " pod="kserve/s3-init-rp6cg" Sep 16 13:00:50.913052 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:50.912902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2xh2\" (UniqueName: \"kubernetes.io/projected/0154786f-7288-4406-adb3-adceab91cbe8-kube-api-access-p2xh2\") pod \"s3-init-rp6cg\" (UID: \"0154786f-7288-4406-adb3-adceab91cbe8\") " pod="kserve/s3-init-rp6cg" Sep 16 13:00:51.014112 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:51.014074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0154786f-7288-4406-adb3-adceab91cbe8-model-cache\") pod \"s3-init-rp6cg\" (UID: \"0154786f-7288-4406-adb3-adceab91cbe8\") " pod="kserve/s3-init-rp6cg" Sep 16 13:00:51.014258 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:51.014117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2xh2\" (UniqueName: \"kubernetes.io/projected/0154786f-7288-4406-adb3-adceab91cbe8-kube-api-access-p2xh2\") pod \"s3-init-rp6cg\" (UID: \"0154786f-7288-4406-adb3-adceab91cbe8\") " pod="kserve/s3-init-rp6cg" Sep 16 13:00:51.014445 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:51.014425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0154786f-7288-4406-adb3-adceab91cbe8-model-cache\") pod \"s3-init-rp6cg\" (UID: \"0154786f-7288-4406-adb3-adceab91cbe8\") " pod="kserve/s3-init-rp6cg" Sep 16 13:00:51.025334 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:51.025304 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2xh2\" (UniqueName: \"kubernetes.io/projected/0154786f-7288-4406-adb3-adceab91cbe8-kube-api-access-p2xh2\") pod \"s3-init-rp6cg\" (UID: \"0154786f-7288-4406-adb3-adceab91cbe8\") " pod="kserve/s3-init-rp6cg" Sep 16 13:00:51.115036 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:51.115002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-rp6cg" Sep 16 13:00:51.389199 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:51.389119 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-rp6cg"] Sep 16 13:00:51.392430 ip-10-0-137-26 kubenswrapper[2580]: W0916 13:00:51.392400 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0154786f_7288_4406_adb3_adceab91cbe8.slice/crio-e8d219b543080ce5b4808aa89d19256b6f52a17658cd1ea73d6af86612b2b64c WatchSource:0}: Error finding container e8d219b543080ce5b4808aa89d19256b6f52a17658cd1ea73d6af86612b2b64c: Status 404 returned error can't find the container with id e8d219b543080ce5b4808aa89d19256b6f52a17658cd1ea73d6af86612b2b64c Sep 16 13:00:51.410558 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:51.410527 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-rp6cg" event={"ID":"0154786f-7288-4406-adb3-adceab91cbe8","Type":"ContainerStarted","Data":"e8d219b543080ce5b4808aa89d19256b6f52a17658cd1ea73d6af86612b2b64c"} Sep 16 13:00:55.429241 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:55.429206 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-rp6cg" event={"ID":"0154786f-7288-4406-adb3-adceab91cbe8","Type":"ContainerStarted","Data":"0d4971c84968d78ce2b35a305c4b0033b8fcf07f6fd702a0cf7b811a45a19910"} Sep 16 13:00:57.437716 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:57.437685 2580 generic.go:356] "Generic (PLEG): container finished" podID="0154786f-7288-4406-adb3-adceab91cbe8" containerID="0d4971c84968d78ce2b35a305c4b0033b8fcf07f6fd702a0cf7b811a45a19910" exitCode=0 Sep 16 13:00:57.438050 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:00:57.437752 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-rp6cg" event={"ID":"0154786f-7288-4406-adb3-adceab91cbe8","Type":"ContainerDied","Data":"0d4971c84968d78ce2b35a305c4b0033b8fcf07f6fd702a0cf7b811a45a19910"} Sep 16 13:01:01.784190 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:01:01.784167 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 16 13:01:02.466609 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:01:02.466574 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-rp6cg" event={"ID":"0154786f-7288-4406-adb3-adceab91cbe8","Type":"ContainerStarted","Data":"2a9dfdea61fd3c9e32b52ff3d3d1d9a88d199af790401cffa916ec0535248eb6"} Sep 16 13:01:02.498997 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:01:02.498950 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-rp6cg" podStartSLOduration=3.051056382 podStartE2EDuration="12.498933291s" totalImagesPullingTime="7.816438945s" totalInitContainerRuntime="1.631437964s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:00:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:02.496694044 +0000 UTC m=+785.555202958" watchObservedRunningTime="2026-09-16 13:01:02.498933291 +0000 UTC m=+785.557442200" Sep 16 13:02:06.706428 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:06.706395 2580 generic.go:356] "Generic (PLEG): container finished" podID="0154786f-7288-4406-adb3-adceab91cbe8" containerID="2a9dfdea61fd3c9e32b52ff3d3d1d9a88d199af790401cffa916ec0535248eb6" exitCode=0 Sep 16 13:02:06.706828 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:06.706466 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-rp6cg" event={"ID":"0154786f-7288-4406-adb3-adceab91cbe8","Type":"ContainerDied","Data":"2a9dfdea61fd3c9e32b52ff3d3d1d9a88d199af790401cffa916ec0535248eb6"} Sep 16 13:02:07.827427 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:07.827403 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-rp6cg" Sep 16 13:02:07.949150 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:07.949124 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0154786f-7288-4406-adb3-adceab91cbe8-model-cache\") pod \"0154786f-7288-4406-adb3-adceab91cbe8\" (UID: \"0154786f-7288-4406-adb3-adceab91cbe8\") " Sep 16 13:02:07.949318 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:07.949181 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2xh2\" (UniqueName: \"kubernetes.io/projected/0154786f-7288-4406-adb3-adceab91cbe8-kube-api-access-p2xh2\") pod \"0154786f-7288-4406-adb3-adceab91cbe8\" (UID: \"0154786f-7288-4406-adb3-adceab91cbe8\") " Sep 16 13:02:07.951359 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:07.951335 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0154786f-7288-4406-adb3-adceab91cbe8-kube-api-access-p2xh2" (OuterVolumeSpecName: "kube-api-access-p2xh2") pod "0154786f-7288-4406-adb3-adceab91cbe8" (UID: "0154786f-7288-4406-adb3-adceab91cbe8"). InnerVolumeSpecName "kube-api-access-p2xh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 13:02:07.970679 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:07.970624 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0154786f-7288-4406-adb3-adceab91cbe8-model-cache" (OuterVolumeSpecName: "model-cache") pod "0154786f-7288-4406-adb3-adceab91cbe8" (UID: "0154786f-7288-4406-adb3-adceab91cbe8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 13:02:08.049915 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:08.049886 2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0154786f-7288-4406-adb3-adceab91cbe8-model-cache\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:02:08.049915 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:08.049910 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2xh2\" (UniqueName: \"kubernetes.io/projected/0154786f-7288-4406-adb3-adceab91cbe8-kube-api-access-p2xh2\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:02:08.715919 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:08.715889 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-rp6cg" event={"ID":"0154786f-7288-4406-adb3-adceab91cbe8","Type":"ContainerDied","Data":"e8d219b543080ce5b4808aa89d19256b6f52a17658cd1ea73d6af86612b2b64c"} Sep 16 13:02:08.716080 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:08.715927 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8d219b543080ce5b4808aa89d19256b6f52a17658cd1ea73d6af86612b2b64c" Sep 16 13:02:08.716080 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:08.715926 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-rp6cg" Sep 16 13:02:21.201486 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.201442 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr"] Sep 16 13:02:21.202205 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.202181 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0154786f-7288-4406-adb3-adceab91cbe8" containerName="s3-init" Sep 16 13:02:21.202281 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.202209 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0154786f-7288-4406-adb3-adceab91cbe8" containerName="s3-init" Sep 16 13:02:21.202281 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.202238 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0154786f-7288-4406-adb3-adceab91cbe8" containerName="download-hf-model" Sep 16 13:02:21.202281 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.202247 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0154786f-7288-4406-adb3-adceab91cbe8" containerName="download-hf-model" Sep 16 13:02:21.202409 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.202386 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0154786f-7288-4406-adb3-adceab91cbe8" containerName="s3-init" Sep 16 13:02:21.206268 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.206243 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.208066 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.208033 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 16 13:02:21.208192 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.208106 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Sep 16 13:02:21.208266 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.208193 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 16 13:02:21.208344 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.208309 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Sep 16 13:02:21.208344 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.208316 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 16 13:02:21.208344 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.208330 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 16 13:02:21.208573 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.208551 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-gdsnl\"" Sep 16 13:02:21.214675 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.214656 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr"] Sep 16 13:02:21.360349 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.360317 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.360511 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.360369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srg5n\" (UniqueName: \"kubernetes.io/projected/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-api-access-srg5n\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.360511 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.360396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.360511 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.360443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.360633 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.360513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.461586 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.461506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.461586 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.461570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.461797 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.461602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srg5n\" (UniqueName: \"kubernetes.io/projected/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-api-access-srg5n\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.461797 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.461621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.461797 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.461642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.461797 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:02:21.461756 2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Sep 16 13:02:21.462021 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:02:21.461831 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-proxy-tls podName:e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f nodeName:}" failed. No retries permitted until 2026-09-16 13:02:21.961811706 +0000 UTC m=+865.020320612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-proxy-tls") pod "isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" (UID: "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Sep 16 13:02:21.462099 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.462079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.462418 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.462396 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.462452 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.462406 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.469351 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.469328 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srg5n\" (UniqueName: \"kubernetes.io/projected/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-api-access-srg5n\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.480340 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.480316 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6"] Sep 16 13:02:21.482796 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.482778 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.484501 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.484479 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Sep 16 13:02:21.484581 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.484509 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Sep 16 13:02:21.494441 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.494418 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6"] Sep 16 13:02:21.562494 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.562462 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.562648 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.562502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bda03f2c-247d-4f05-946e-c7be14e55171-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.562648 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.562578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql6tq\" (UniqueName: \"kubernetes.io/projected/bda03f2c-247d-4f05-946e-c7be14e55171-kube-api-access-ql6tq\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.562723 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.562649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bda03f2c-247d-4f05-946e-c7be14e55171-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.562723 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.562668 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.663613 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.663582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bda03f2c-247d-4f05-946e-c7be14e55171-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.663801 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.663631 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql6tq\" (UniqueName: \"kubernetes.io/projected/bda03f2c-247d-4f05-946e-c7be14e55171-kube-api-access-ql6tq\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.663801 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:02:21.663751 2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found Sep 16 13:02:21.663801 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.663774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bda03f2c-247d-4f05-946e-c7be14e55171-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.663981 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.663805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.663981 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:02:21.663839 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bda03f2c-247d-4f05-946e-c7be14e55171-proxy-tls podName:bda03f2c-247d-4f05-946e-c7be14e55171 nodeName:}" failed. No retries permitted until 2026-09-16 13:02:22.163818349 +0000 UTC m=+865.222327249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/bda03f2c-247d-4f05-946e-c7be14e55171-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-tt8j6" (UID: "bda03f2c-247d-4f05-946e-c7be14e55171") : secret "isvc-xgboost-graph-predictor-serving-cert" not found Sep 16 13:02:21.663981 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.663933 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.664285 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.664262 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bda03f2c-247d-4f05-946e-c7be14e55171-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.664427 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.664406 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.664543 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.664524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.669022 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.668995 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm"] Sep 16 13:02:21.671724 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.671708 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.673434 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.673410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Sep 16 13:02:21.673534 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.673414 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Sep 16 13:02:21.675332 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.675313 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql6tq\" (UniqueName: \"kubernetes.io/projected/bda03f2c-247d-4f05-946e-c7be14e55171-kube-api-access-ql6tq\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:21.684641 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.684615 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm"] Sep 16 13:02:21.764794 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.764699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8163fddf-555b-4fcf-ae0d-378fb3d0908a-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.764794 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.764763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2lz9\" (UniqueName: \"kubernetes.io/projected/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-api-access-n2lz9\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.764794 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.764783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.765029 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.764798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.765029 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.764836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.865678 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.865637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8163fddf-555b-4fcf-ae0d-378fb3d0908a-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.865678 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.865680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2lz9\" (UniqueName: \"kubernetes.io/projected/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-api-access-n2lz9\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.865898 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.865706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.865898 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:02:21.865878 2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-serving-cert: secret "isvc-sklearn-graph-2-predictor-serving-cert" not found Sep 16 13:02:21.865969 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:02:21.865955 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8163fddf-555b-4fcf-ae0d-378fb3d0908a-proxy-tls podName:8163fddf-555b-4fcf-ae0d-378fb3d0908a nodeName:}" failed. No retries permitted until 2026-09-16 13:02:22.365939721 +0000 UTC m=+865.424448613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/8163fddf-555b-4fcf-ae0d-378fb3d0908a-proxy-tls") pod "isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" (UID: "8163fddf-555b-4fcf-ae0d-378fb3d0908a") : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found Sep 16 13:02:21.866023 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.865879 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.866068 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.866036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.866267 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.866246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.866536 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.866517 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.866710 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.866689 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.873325 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.873296 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2lz9\" (UniqueName: \"kubernetes.io/projected/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-api-access-n2lz9\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:21.967437 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.967409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:21.969838 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:21.969811 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:22.117266 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.117229 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:22.169669 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.169638 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bda03f2c-247d-4f05-946e-c7be14e55171-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:22.172043 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.172015 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bda03f2c-247d-4f05-946e-c7be14e55171-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tt8j6\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:22.371683 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.371608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8163fddf-555b-4fcf-ae0d-378fb3d0908a-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:22.373950 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.373931 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8163fddf-555b-4fcf-ae0d-378fb3d0908a-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:22.389519 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.389395 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr"] Sep 16 13:02:22.392058 ip-10-0-137-26 kubenswrapper[2580]: W0916 13:02:22.392033 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a5c8cd_19d7_444e_a3c8_eb8e7de0b10f.slice/crio-610d40222b86b41c29c868e67a6cc35b0868e14daa5f92f07d550ffc8b21036b WatchSource:0}: Error finding container 610d40222b86b41c29c868e67a6cc35b0868e14daa5f92f07d550ffc8b21036b: Status 404 returned error can't find the container with id 610d40222b86b41c29c868e67a6cc35b0868e14daa5f92f07d550ffc8b21036b Sep 16 13:02:22.392160 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.392118 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:22.588676 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.588637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:22.668768 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.668738 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6"] Sep 16 13:02:22.670564 ip-10-0-137-26 kubenswrapper[2580]: W0916 13:02:22.670531 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda03f2c_247d_4f05_946e_c7be14e55171.slice/crio-e5c7ad8981f6767643ef6aaaf9a304f9d35a23d659ea99ce0f00f5285446e8fb WatchSource:0}: Error finding container e5c7ad8981f6767643ef6aaaf9a304f9d35a23d659ea99ce0f00f5285446e8fb: Status 404 returned error can't find the container with id e5c7ad8981f6767643ef6aaaf9a304f9d35a23d659ea99ce0f00f5285446e8fb Sep 16 13:02:22.768054 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.768012 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" event={"ID":"bda03f2c-247d-4f05-946e-c7be14e55171","Type":"ContainerStarted","Data":"af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2"} Sep 16 13:02:22.768202 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.768082 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" event={"ID":"bda03f2c-247d-4f05-946e-c7be14e55171","Type":"ContainerStarted","Data":"e5c7ad8981f6767643ef6aaaf9a304f9d35a23d659ea99ce0f00f5285446e8fb"} Sep 16 13:02:22.769953 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.769929 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" event={"ID":"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f","Type":"ContainerStarted","Data":"829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042"} Sep 16 13:02:22.770054 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.769990 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" event={"ID":"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f","Type":"ContainerStarted","Data":"610d40222b86b41c29c868e67a6cc35b0868e14daa5f92f07d550ffc8b21036b"} Sep 16 13:02:22.863533 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:22.863503 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm"] Sep 16 13:02:22.867222 ip-10-0-137-26 kubenswrapper[2580]: W0916 13:02:22.867188 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8163fddf_555b_4fcf_ae0d_378fb3d0908a.slice/crio-f3614828bec38fa1c7ff5abae4e9e0cb1d03f45a15be4e81a53f47c3d469b69f WatchSource:0}: Error finding container f3614828bec38fa1c7ff5abae4e9e0cb1d03f45a15be4e81a53f47c3d469b69f: Status 404 returned error can't find the container with id f3614828bec38fa1c7ff5abae4e9e0cb1d03f45a15be4e81a53f47c3d469b69f Sep 16 13:02:23.775159 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:23.775125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" event={"ID":"8163fddf-555b-4fcf-ae0d-378fb3d0908a","Type":"ContainerStarted","Data":"b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069"} Sep 16 13:02:23.775584 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:23.775190 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" event={"ID":"8163fddf-555b-4fcf-ae0d-378fb3d0908a","Type":"ContainerStarted","Data":"f3614828bec38fa1c7ff5abae4e9e0cb1d03f45a15be4e81a53f47c3d469b69f"} Sep 16 13:02:26.790815 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:26.790784 2580 generic.go:356] "Generic (PLEG): container finished" podID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerID="829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042" exitCode=0 Sep 16 13:02:26.791243 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:26.790869 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" event={"ID":"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f","Type":"ContainerDied","Data":"829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042"} Sep 16 13:02:26.792879 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:26.792837 2580 generic.go:356] "Generic (PLEG): container finished" podID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerID="b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069" exitCode=0 Sep 16 13:02:26.793073 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:26.792927 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" event={"ID":"8163fddf-555b-4fcf-ae0d-378fb3d0908a","Type":"ContainerDied","Data":"b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069"} Sep 16 13:02:27.815036 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:27.813959 2580 generic.go:356] "Generic (PLEG): container finished" podID="bda03f2c-247d-4f05-946e-c7be14e55171" containerID="af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2" exitCode=0 Sep 16 13:02:27.815036 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:27.814053 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" event={"ID":"bda03f2c-247d-4f05-946e-c7be14e55171","Type":"ContainerDied","Data":"af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2"} Sep 16 13:02:55.985867 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:55.985754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" event={"ID":"bda03f2c-247d-4f05-946e-c7be14e55171","Type":"ContainerStarted","Data":"7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600"} Sep 16 13:02:55.989194 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:55.989102 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" event={"ID":"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f","Type":"ContainerStarted","Data":"c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5"} Sep 16 13:02:55.993056 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:55.993030 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" event={"ID":"8163fddf-555b-4fcf-ae0d-378fb3d0908a","Type":"ContainerStarted","Data":"6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302"} Sep 16 13:02:58.004014 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.003982 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" event={"ID":"8163fddf-555b-4fcf-ae0d-378fb3d0908a","Type":"ContainerStarted","Data":"c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5"} Sep 16 13:02:58.004448 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.004123 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:58.004448 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.004184 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:02:58.005914 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.005878 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:02:58.008959 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.008298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" event={"ID":"bda03f2c-247d-4f05-946e-c7be14e55171","Type":"ContainerStarted","Data":"872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057"} Sep 16 13:02:58.008959 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.008634 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:58.008959 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.008683 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:02:58.009888 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.009667 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 16 13:02:58.012976 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.012901 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" event={"ID":"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f","Type":"ContainerStarted","Data":"c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932"} Sep 16 13:02:58.013408 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.013293 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:58.013637 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.013369 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:02:58.014249 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.014220 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:02:58.024258 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.024215 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podStartSLOduration=2.355435769 podStartE2EDuration="37.024199693s" totalImagesPullingTime="30.98675526s" totalInitContainerRuntime="3.682008664s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:02:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:02:58.023217098 +0000 UTC m=+901.081726006" watchObservedRunningTime="2026-09-16 13:02:58.024199693 +0000 UTC m=+901.082708668" Sep 16 13:02:58.044061 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.044018 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podStartSLOduration=2.116331672 podStartE2EDuration="37.044005285s" totalImagesPullingTime="31.000680596s" totalInitContainerRuntime="3.926993017s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:02:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:02:58.04230101 +0000 UTC m=+901.100809920" watchObservedRunningTime="2026-09-16 13:02:58.044005285 +0000 UTC m=+901.102514195" Sep 16 13:02:58.060099 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:58.060061 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podStartSLOduration=3.050888462 podStartE2EDuration="37.060047031s" totalImagesPullingTime="29.955378683s" totalInitContainerRuntime="4.053779886s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:02:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:02:58.05869677 +0000 UTC m=+901.117205678" watchObservedRunningTime="2026-09-16 13:02:58.060047031 +0000 UTC m=+901.118555939" Sep 16 13:02:59.017998 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:59.017960 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:02:59.018450 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:59.018399 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 16 13:02:59.018450 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:02:59.018406 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:03:00.023119 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:00.023072 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 16 13:03:04.022172 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:04.022142 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:03:04.022612 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:04.022552 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:03:04.022612 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:04.022586 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:03:04.022966 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:04.022936 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:03:05.028067 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:05.028039 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:03:05.028686 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:05.028663 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 16 13:03:14.023535 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:14.023495 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:03:14.023919 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:14.023495 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:03:15.028931 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:15.028894 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 16 13:03:24.023055 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:24.023012 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:03:24.023639 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:24.023025 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:03:25.028956 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:25.028917 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 16 13:03:34.022761 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:34.022723 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:03:34.023320 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:34.023014 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:03:35.029323 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:35.029286 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 16 13:03:44.022576 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:44.022537 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:03:44.023151 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:44.023022 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:03:45.029512 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:45.029470 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 16 13:03:54.022664 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:54.022619 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:03:54.023244 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:54.022970 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:03:55.028727 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:03:55.028692 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused" Sep 16 13:04:04.022605 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:04.022566 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:04:04.024192 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:04.023761 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:04:05.029998 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:05.029970 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:04:05.396835 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:05.396798 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:04:14.023760 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:14.023731 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:04:15.401336 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:15.401310 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:04:51.342605 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.342570 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm"] Sep 16 13:04:51.343224 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.342832 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" containerID="cri-o://6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302" gracePeriod=30 Sep 16 13:04:51.343224 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.342862 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kube-rbac-proxy" containerID="cri-o://c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5" gracePeriod=30 Sep 16 13:04:51.384128 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.384096 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr"] Sep 16 13:04:51.384337 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.384318 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" containerID="cri-o://c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5" gracePeriod=30 Sep 16 13:04:51.384386 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.384357 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kube-rbac-proxy" containerID="cri-o://c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932" gracePeriod=30 Sep 16 13:04:51.418939 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.418910 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6"] Sep 16 13:04:51.419183 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.419156 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kube-rbac-proxy" containerID="cri-o://872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057" gracePeriod=30 Sep 16 13:04:51.419296 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.419154 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" containerID="cri-o://7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600" gracePeriod=30 Sep 16 13:04:51.484142 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.484109 2580 generic.go:356] "Generic (PLEG): container finished" podID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerID="c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5" exitCode=2 Sep 16 13:04:51.484313 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:51.484178 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" event={"ID":"8163fddf-555b-4fcf-ae0d-378fb3d0908a","Type":"ContainerDied","Data":"c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5"} Sep 16 13:04:52.489742 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:52.489709 2580 generic.go:356] "Generic (PLEG): container finished" podID="bda03f2c-247d-4f05-946e-c7be14e55171" containerID="872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057" exitCode=2 Sep 16 13:04:52.490172 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:52.489784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" event={"ID":"bda03f2c-247d-4f05-946e-c7be14e55171","Type":"ContainerDied","Data":"872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057"} Sep 16 13:04:52.491748 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:52.491728 2580 generic.go:356] "Generic (PLEG): container finished" podID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerID="c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932" exitCode=2 Sep 16 13:04:52.491873 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:52.491757 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" event={"ID":"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f","Type":"ContainerDied","Data":"c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932"} Sep 16 13:04:54.019043 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.019006 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused" Sep 16 13:04:54.019459 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.019015 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.21:8643/healthz\": dial tcp 10.133.0.21:8643: connect: connection refused" Sep 16 13:04:54.023340 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.023315 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused" Sep 16 13:04:54.865020 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.864997 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:04:54.986527 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.986453 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bda03f2c-247d-4f05-946e-c7be14e55171-kserve-provision-location\") pod \"bda03f2c-247d-4f05-946e-c7be14e55171\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " Sep 16 13:04:54.986527 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.986518 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-cabundle-cert\") pod \"bda03f2c-247d-4f05-946e-c7be14e55171\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " Sep 16 13:04:54.986702 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.986542 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ql6tq\" (UniqueName: \"kubernetes.io/projected/bda03f2c-247d-4f05-946e-c7be14e55171-kube-api-access-ql6tq\") pod \"bda03f2c-247d-4f05-946e-c7be14e55171\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " Sep 16 13:04:54.986702 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.986559 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bda03f2c-247d-4f05-946e-c7be14e55171-proxy-tls\") pod \"bda03f2c-247d-4f05-946e-c7be14e55171\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " Sep 16 13:04:54.986702 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.986596 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-kube-rbac-proxy-sar-config\") pod \"bda03f2c-247d-4f05-946e-c7be14e55171\" (UID: \"bda03f2c-247d-4f05-946e-c7be14e55171\") " Sep 16 13:04:54.986880 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.986796 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda03f2c-247d-4f05-946e-c7be14e55171-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "bda03f2c-247d-4f05-946e-c7be14e55171" (UID: "bda03f2c-247d-4f05-946e-c7be14e55171"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 13:04:54.986948 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.986881 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "bda03f2c-247d-4f05-946e-c7be14e55171" (UID: "bda03f2c-247d-4f05-946e-c7be14e55171"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 13:04:54.987088 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.987065 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "bda03f2c-247d-4f05-946e-c7be14e55171" (UID: "bda03f2c-247d-4f05-946e-c7be14e55171"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 13:04:54.988750 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.988729 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda03f2c-247d-4f05-946e-c7be14e55171-kube-api-access-ql6tq" (OuterVolumeSpecName: "kube-api-access-ql6tq") pod "bda03f2c-247d-4f05-946e-c7be14e55171" (UID: "bda03f2c-247d-4f05-946e-c7be14e55171"). InnerVolumeSpecName "kube-api-access-ql6tq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 13:04:54.988867 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:54.988830 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda03f2c-247d-4f05-946e-c7be14e55171-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bda03f2c-247d-4f05-946e-c7be14e55171" (UID: "bda03f2c-247d-4f05-946e-c7be14e55171"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 13:04:55.087740 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.087695 2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bda03f2c-247d-4f05-946e-c7be14e55171-kserve-provision-location\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:55.087740 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.087735 2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-cabundle-cert\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:55.087740 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.087750 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql6tq\" (UniqueName: \"kubernetes.io/projected/bda03f2c-247d-4f05-946e-c7be14e55171-kube-api-access-ql6tq\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:55.088155 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.087764 2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bda03f2c-247d-4f05-946e-c7be14e55171-proxy-tls\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:55.088155 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.087777 2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bda03f2c-247d-4f05-946e-c7be14e55171-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:55.397025 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.396981 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.21:8080: connect: connection refused" Sep 16 13:04:55.506555 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.506524 2580 generic.go:356] "Generic (PLEG): container finished" podID="bda03f2c-247d-4f05-946e-c7be14e55171" containerID="7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600" exitCode=0 Sep 16 13:04:55.506729 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.506606 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" Sep 16 13:04:55.506729 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.506610 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" event={"ID":"bda03f2c-247d-4f05-946e-c7be14e55171","Type":"ContainerDied","Data":"7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600"} Sep 16 13:04:55.506820 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.506738 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6" event={"ID":"bda03f2c-247d-4f05-946e-c7be14e55171","Type":"ContainerDied","Data":"e5c7ad8981f6767643ef6aaaf9a304f9d35a23d659ea99ce0f00f5285446e8fb"} Sep 16 13:04:55.506820 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.506767 2580 scope.go:117] "RemoveContainer" containerID="872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057" Sep 16 13:04:55.516629 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.516612 2580 scope.go:117] "RemoveContainer" containerID="7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600" Sep 16 13:04:55.522397 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.522370 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6"] Sep 16 13:04:55.524300 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.524284 2580 scope.go:117] "RemoveContainer" containerID="af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2" Sep 16 13:04:55.528687 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.528662 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tt8j6"] Sep 16 13:04:55.531697 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.531677 2580 scope.go:117] "RemoveContainer" containerID="872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057" Sep 16 13:04:55.531977 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:04:55.531956 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057\": container with ID starting with 872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057 not found: ID does not exist" containerID="872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057" Sep 16 13:04:55.532048 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.531986 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057"} err="failed to get container status \"872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057\": rpc error: code = NotFound desc = could not find container \"872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057\": container with ID starting with 872817ca6c2ffd887ea024b1cf8231c2a471d17c157daa02ea35b5e69cf7c057 not found: ID does not exist" Sep 16 13:04:55.532048 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.532004 2580 scope.go:117] "RemoveContainer" containerID="7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600" Sep 16 13:04:55.532258 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:04:55.532241 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600\": container with ID starting with 7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600 not found: ID does not exist" containerID="7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600" Sep 16 13:04:55.532299 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.532262 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600"} err="failed to get container status \"7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600\": rpc error: code = NotFound desc = could not find container \"7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600\": container with ID starting with 7dc839bec9c1bcedddb242ec721b76f7f10738b0938f58bdec1f177b44b66600 not found: ID does not exist" Sep 16 13:04:55.532299 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.532275 2580 scope.go:117] "RemoveContainer" containerID="af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2" Sep 16 13:04:55.532509 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:04:55.532492 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2\": container with ID starting with af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2 not found: ID does not exist" containerID="af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2" Sep 16 13:04:55.532581 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:55.532512 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2"} err="failed to get container status \"af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2\": rpc error: code = NotFound desc = could not find container \"af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2\": container with ID starting with af0394450fb40967cb0c550f2c9f112d69f45020ca4fe68c07e970b745bb5af2 not found: ID does not exist" Sep 16 13:04:56.248094 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.248061 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:04:56.250891 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.250871 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:04:56.398362 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398332 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kserve-provision-location\") pod \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " Sep 16 13:04:56.398594 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398371 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-rbac-proxy-sar-config\") pod \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " Sep 16 13:04:56.398594 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398391 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8163fddf-555b-4fcf-ae0d-378fb3d0908a-proxy-tls\") pod \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " Sep 16 13:04:56.398594 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398406 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2lz9\" (UniqueName: \"kubernetes.io/projected/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-api-access-n2lz9\") pod \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " Sep 16 13:04:56.398594 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398420 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-cabundle-cert\") pod \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " Sep 16 13:04:56.398594 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398437 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-proxy-tls\") pod \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " Sep 16 13:04:56.398594 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398562 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kserve-provision-location\") pod \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " Sep 16 13:04:56.398922 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398620 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-cabundle-cert\") pod \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " Sep 16 13:04:56.398922 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398657 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srg5n\" (UniqueName: \"kubernetes.io/projected/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-api-access-srg5n\") pod \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\" (UID: \"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f\") " Sep 16 13:04:56.398922 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398696 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-rbac-proxy-sar-config\") pod \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\" (UID: \"8163fddf-555b-4fcf-ae0d-378fb3d0908a\") " Sep 16 13:04:56.398922 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398729 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8163fddf-555b-4fcf-ae0d-378fb3d0908a" (UID: "8163fddf-555b-4fcf-ae0d-378fb3d0908a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 13:04:56.398922 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398764 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" (UID: "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 13:04:56.399165 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398967 2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kserve-provision-location\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.399165 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.398984 2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.399165 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.399023 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" (UID: "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 13:04:56.399165 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.399109 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" (UID: "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 13:04:56.399165 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.399123 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "8163fddf-555b-4fcf-ae0d-378fb3d0908a" (UID: "8163fddf-555b-4fcf-ae0d-378fb3d0908a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 13:04:56.399392 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.399318 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "8163fddf-555b-4fcf-ae0d-378fb3d0908a" (UID: "8163fddf-555b-4fcf-ae0d-378fb3d0908a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 13:04:56.400646 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.400614 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" (UID: "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 13:04:56.400646 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.400640 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8163fddf-555b-4fcf-ae0d-378fb3d0908a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8163fddf-555b-4fcf-ae0d-378fb3d0908a" (UID: "8163fddf-555b-4fcf-ae0d-378fb3d0908a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 13:04:56.401244 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.401222 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-api-access-srg5n" (OuterVolumeSpecName: "kube-api-access-srg5n") pod "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" (UID: "e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f"). InnerVolumeSpecName "kube-api-access-srg5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 13:04:56.401244 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.401230 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-api-access-n2lz9" (OuterVolumeSpecName: "kube-api-access-n2lz9") pod "8163fddf-555b-4fcf-ae0d-378fb3d0908a" (UID: "8163fddf-555b-4fcf-ae0d-378fb3d0908a"). InnerVolumeSpecName "kube-api-access-n2lz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 13:04:56.499881 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.499833 2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-cabundle-cert\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.499881 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.499882 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srg5n\" (UniqueName: \"kubernetes.io/projected/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kube-api-access-srg5n\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.500074 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.499898 2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.500074 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.499912 2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8163fddf-555b-4fcf-ae0d-378fb3d0908a-proxy-tls\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.500074 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.499928 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2lz9\" (UniqueName: \"kubernetes.io/projected/8163fddf-555b-4fcf-ae0d-378fb3d0908a-kube-api-access-n2lz9\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.500074 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.499942 2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8163fddf-555b-4fcf-ae0d-378fb3d0908a-cabundle-cert\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.500074 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.499954 2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-proxy-tls\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.500074 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.499967 2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f-kserve-provision-location\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:04:56.513476 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.513448 2580 generic.go:356] "Generic (PLEG): container finished" podID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerID="6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302" exitCode=0 Sep 16 13:04:56.513589 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.513520 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" Sep 16 13:04:56.513589 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.513529 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" event={"ID":"8163fddf-555b-4fcf-ae0d-378fb3d0908a","Type":"ContainerDied","Data":"6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302"} Sep 16 13:04:56.513589 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.513587 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm" event={"ID":"8163fddf-555b-4fcf-ae0d-378fb3d0908a","Type":"ContainerDied","Data":"f3614828bec38fa1c7ff5abae4e9e0cb1d03f45a15be4e81a53f47c3d469b69f"} Sep 16 13:04:56.513744 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.513614 2580 scope.go:117] "RemoveContainer" containerID="c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5" Sep 16 13:04:56.516741 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.516706 2580 generic.go:356] "Generic (PLEG): container finished" podID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerID="c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5" exitCode=0 Sep 16 13:04:56.516874 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.516767 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" Sep 16 13:04:56.516874 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.516764 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" event={"ID":"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f","Type":"ContainerDied","Data":"c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5"} Sep 16 13:04:56.516988 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.516878 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr" event={"ID":"e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f","Type":"ContainerDied","Data":"610d40222b86b41c29c868e67a6cc35b0868e14daa5f92f07d550ffc8b21036b"} Sep 16 13:04:56.522579 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.522559 2580 scope.go:117] "RemoveContainer" containerID="6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302" Sep 16 13:04:56.530174 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.530156 2580 scope.go:117] "RemoveContainer" containerID="b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069" Sep 16 13:04:56.535732 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.535708 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm"] Sep 16 13:04:56.538366 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.538348 2580 scope.go:117] "RemoveContainer" containerID="c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5" Sep 16 13:04:56.538665 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:04:56.538640 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5\": container with ID starting with c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5 not found: ID does not exist" containerID="c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5" Sep 16 13:04:56.538763 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.538670 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5"} err="failed to get container status \"c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5\": rpc error: code = NotFound desc = could not find container \"c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5\": container with ID starting with c2e46125ee3fc7f170cb43179f45a3a9d239e725a44435cb98185bfa7f6426b5 not found: ID does not exist" Sep 16 13:04:56.538763 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.538686 2580 scope.go:117] "RemoveContainer" containerID="6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302" Sep 16 13:04:56.539090 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:04:56.539070 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302\": container with ID starting with 6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302 not found: ID does not exist" containerID="6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302" Sep 16 13:04:56.539090 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.539084 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57ff788c5f-sqfhm"] Sep 16 13:04:56.539193 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.539095 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302"} err="failed to get container status \"6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302\": rpc error: code = NotFound desc = could not find container \"6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302\": container with ID starting with 6f5cf01098e006cac335720fdfd49611a32852cb227f1eca03aa9ca2ba643302 not found: ID does not exist" Sep 16 13:04:56.539193 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.539113 2580 scope.go:117] "RemoveContainer" containerID="b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069" Sep 16 13:04:56.539383 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:04:56.539367 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069\": container with ID starting with b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069 not found: ID does not exist" containerID="b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069" Sep 16 13:04:56.539447 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.539390 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069"} err="failed to get container status \"b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069\": rpc error: code = NotFound desc = could not find container \"b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069\": container with ID starting with b03ac140491c4b5b67397204dd669de4c588da4a21c2fc15a2910895ac1c8069 not found: ID does not exist" Sep 16 13:04:56.539447 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.539411 2580 scope.go:117] "RemoveContainer" containerID="c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932" Sep 16 13:04:56.546621 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.546603 2580 scope.go:117] "RemoveContainer" containerID="c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5" Sep 16 13:04:56.547514 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.547446 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr"] Sep 16 13:04:56.552922 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.552901 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-68ccccbd85-gd5jr"] Sep 16 13:04:56.553599 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.553587 2580 scope.go:117] "RemoveContainer" containerID="829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042" Sep 16 13:04:56.560234 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.560208 2580 scope.go:117] "RemoveContainer" containerID="c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932" Sep 16 13:04:56.560487 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:04:56.560467 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932\": container with ID starting with c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932 not found: ID does not exist" containerID="c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932" Sep 16 13:04:56.560527 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.560491 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932"} err="failed to get container status \"c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932\": rpc error: code = NotFound desc = could not find container \"c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932\": container with ID starting with c6fc1405456e6df2acdd73c7535db13adeb3d6d0e5b2f694e8f8fb138f31a932 not found: ID does not exist" Sep 16 13:04:56.560527 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.560508 2580 scope.go:117] "RemoveContainer" containerID="c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5" Sep 16 13:04:56.560793 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:04:56.560776 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5\": container with ID starting with c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5 not found: ID does not exist" containerID="c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5" Sep 16 13:04:56.560831 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.560799 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5"} err="failed to get container status \"c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5\": rpc error: code = NotFound desc = could not find container \"c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5\": container with ID starting with c5a9171e9221d8c8215da753c5ce9666169439f4f9b22e7c09882dd3031599a5 not found: ID does not exist" Sep 16 13:04:56.560831 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.560813 2580 scope.go:117] "RemoveContainer" containerID="829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042" Sep 16 13:04:56.561047 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:04:56.561030 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042\": container with ID starting with 829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042 not found: ID does not exist" containerID="829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042" Sep 16 13:04:56.561085 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:56.561050 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042"} err="failed to get container status \"829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042\": rpc error: code = NotFound desc = could not find container \"829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042\": container with ID starting with 829adb4cab383f699ebf2a9b266459cdf7f51badd6c53e1f81e54a56ed376042 not found: ID does not exist" Sep 16 13:04:57.401237 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:57.401198 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" path="/var/lib/kubelet/pods/8163fddf-555b-4fcf-ae0d-378fb3d0908a/volumes" Sep 16 13:04:57.401748 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:57.401731 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" path="/var/lib/kubelet/pods/bda03f2c-247d-4f05-946e-c7be14e55171/volumes" Sep 16 13:04:57.402369 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:04:57.402339 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" path="/var/lib/kubelet/pods/e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f/volumes" Sep 16 13:41:52.281101 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281031 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6lkjf/must-gather-rkjfc"] Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281329 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281340 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281349 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kube-rbac-proxy" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281355 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kube-rbac-proxy" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281365 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="storage-initializer" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281371 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="storage-initializer" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281384 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="storage-initializer" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281389 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="storage-initializer" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281394 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="storage-initializer" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281398 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="storage-initializer" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281404 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281409 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281416 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281421 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281427 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kube-rbac-proxy" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281431 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kube-rbac-proxy" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281438 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kube-rbac-proxy" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281443 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kube-rbac-proxy" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281513 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kserve-container" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281520 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kube-rbac-proxy" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281526 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda03f2c-247d-4f05-946e-c7be14e55171" containerName="kube-rbac-proxy" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281532 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8163fddf-555b-4fcf-ae0d-378fb3d0908a" containerName="kserve-container" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281538 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kserve-container" Sep 16 13:41:52.283541 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.281543 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a5c8cd-19d7-444e-a3c8-eb8e7de0b10f" containerName="kube-rbac-proxy" Sep 16 13:41:52.284520 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.284504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:41:52.286403 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.286377 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6lkjf\"/\"openshift-service-ca.crt\"" Sep 16 13:41:52.286512 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.286411 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6lkjf\"/\"kube-root-ca.crt\"" Sep 16 13:41:52.292045 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.292021 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6lkjf/must-gather-rkjfc"] Sep 16 13:41:52.303178 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.303152 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rnsn\" (UniqueName: \"kubernetes.io/projected/71953758-da4a-49e0-a3f4-d512c5f6f6ad-kube-api-access-7rnsn\") pod \"must-gather-rkjfc\" (UID: \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\") " pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:41:52.303289 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.303185 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71953758-da4a-49e0-a3f4-d512c5f6f6ad-must-gather-output\") pod \"must-gather-rkjfc\" (UID: \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\") " pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:41:52.404540 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.404515 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rnsn\" (UniqueName: \"kubernetes.io/projected/71953758-da4a-49e0-a3f4-d512c5f6f6ad-kube-api-access-7rnsn\") pod \"must-gather-rkjfc\" (UID: \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\") " pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:41:52.404630 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.404553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71953758-da4a-49e0-a3f4-d512c5f6f6ad-must-gather-output\") pod \"must-gather-rkjfc\" (UID: \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\") " pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:41:52.404953 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.404936 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71953758-da4a-49e0-a3f4-d512c5f6f6ad-must-gather-output\") pod \"must-gather-rkjfc\" (UID: \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\") " pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:41:52.412984 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.412959 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rnsn\" (UniqueName: \"kubernetes.io/projected/71953758-da4a-49e0-a3f4-d512c5f6f6ad-kube-api-access-7rnsn\") pod \"must-gather-rkjfc\" (UID: \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\") " pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:41:52.600217 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.600187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:41:52.868464 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.868433 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6lkjf/must-gather-rkjfc"] Sep 16 13:41:52.871138 ip-10-0-137-26 kubenswrapper[2580]: W0916 13:41:52.871109 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71953758_da4a_49e0_a3f4_d512c5f6f6ad.slice/crio-641ff4bae1a5adab660db1f2cb070b97b4e51d903ae3ad481cc5b53a648068bd WatchSource:0}: Error finding container 641ff4bae1a5adab660db1f2cb070b97b4e51d903ae3ad481cc5b53a648068bd: Status 404 returned error can't find the container with id 641ff4bae1a5adab660db1f2cb070b97b4e51d903ae3ad481cc5b53a648068bd Sep 16 13:41:52.872896 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.872879 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 13:41:52.911002 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:52.910974 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" event={"ID":"71953758-da4a-49e0-a3f4-d512c5f6f6ad","Type":"ContainerStarted","Data":"641ff4bae1a5adab660db1f2cb070b97b4e51d903ae3ad481cc5b53a648068bd"} Sep 16 13:41:58.941047 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:58.941008 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" event={"ID":"71953758-da4a-49e0-a3f4-d512c5f6f6ad","Type":"ContainerStarted","Data":"7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a"} Sep 16 13:41:59.947912 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:59.947862 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" event={"ID":"71953758-da4a-49e0-a3f4-d512c5f6f6ad","Type":"ContainerStarted","Data":"72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed"} Sep 16 13:41:59.970921 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:41:59.970861 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" podStartSLOduration=2.02163206 podStartE2EDuration="7.970831244s" totalImagesPullingTime="5.949199184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:41:59.968386887 +0000 UTC m=+3243.026895798" watchObservedRunningTime="2026-09-16 13:41:59.970831244 +0000 UTC m=+3243.029340153" Sep 16 13:42:23.042666 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:23.042632 2580 generic.go:356] "Generic (PLEG): container finished" podID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" containerID="7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a" exitCode=0 Sep 16 13:42:23.043133 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:23.042708 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" event={"ID":"71953758-da4a-49e0-a3f4-d512c5f6f6ad","Type":"ContainerDied","Data":"7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a"} Sep 16 13:42:23.043133 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:23.043040 2580 scope.go:117] "RemoveContainer" containerID="7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a" Sep 16 13:42:23.079501 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:23.079471 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6lkjf_must-gather-rkjfc_71953758-da4a-49e0-a3f4-d512c5f6f6ad/gather/0.log" Sep 16 13:42:26.370693 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:26.370645 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hrnfn_515f7ab2-bbec-4379-9337-2cc15e319b3c/global-pull-secret-syncer/0.log" Sep 16 13:42:26.496128 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:26.496098 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tkbd4_d7e30602-572a-4f2c-8618-2890660a5f75/konnectivity-agent/0.log" Sep 16 13:42:26.518070 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:26.518041 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-26.ec2.internal_8e1f1f6b3289e99d53558e6c90bce9c0/haproxy/0.log" Sep 16 13:42:28.513114 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:28.513077 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6lkjf/must-gather-rkjfc"] Sep 16 13:42:28.513580 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:28.513276 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" containerName="copy" containerID="cri-o://72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed" gracePeriod=2 Sep 16 13:42:28.519160 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:42:28.519128 2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"71953758-da4a-49e0-a3f4-d512c5f6f6ad\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-6lkjf\"/\"must-gather-rkjfc\": pods \"must-gather-rkjfc\" not found" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:42:28.519331 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:28.519190 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6lkjf/must-gather-rkjfc"] Sep 16 13:42:28.738225 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:28.738200 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6lkjf_must-gather-rkjfc_71953758-da4a-49e0-a3f4-d512c5f6f6ad/copy/0.log" Sep 16 13:42:28.739708 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:28.739689 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:42:28.741255 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:42:28.741233 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rkjfc\" is forbidden: User \"system:node:ip-10-0-137-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6lkjf\": no relationship found between node 'ip-10-0-137-26.ec2.internal' and this object" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:42:28.909078 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:28.909044 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71953758-da4a-49e0-a3f4-d512c5f6f6ad-must-gather-output\") pod \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\" (UID: \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\") " Sep 16 13:42:28.909209 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:28.909103 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rnsn\" (UniqueName: \"kubernetes.io/projected/71953758-da4a-49e0-a3f4-d512c5f6f6ad-kube-api-access-7rnsn\") pod \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\" (UID: \"71953758-da4a-49e0-a3f4-d512c5f6f6ad\") " Sep 16 13:42:28.910389 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:28.910354 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71953758-da4a-49e0-a3f4-d512c5f6f6ad-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "71953758-da4a-49e0-a3f4-d512c5f6f6ad" (UID: "71953758-da4a-49e0-a3f4-d512c5f6f6ad"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 13:42:28.911278 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:28.911262 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71953758-da4a-49e0-a3f4-d512c5f6f6ad-kube-api-access-7rnsn" (OuterVolumeSpecName: "kube-api-access-7rnsn") pod "71953758-da4a-49e0-a3f4-d512c5f6f6ad" (UID: "71953758-da4a-49e0-a3f4-d512c5f6f6ad"). InnerVolumeSpecName "kube-api-access-7rnsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 13:42:29.009685 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.009657 2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71953758-da4a-49e0-a3f4-d512c5f6f6ad-must-gather-output\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:42:29.009685 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.009681 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rnsn\" (UniqueName: \"kubernetes.io/projected/71953758-da4a-49e0-a3f4-d512c5f6f6ad-kube-api-access-7rnsn\") on node \"ip-10-0-137-26.ec2.internal\" DevicePath \"\"" Sep 16 13:42:29.068288 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.068261 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6lkjf_must-gather-rkjfc_71953758-da4a-49e0-a3f4-d512c5f6f6ad/copy/0.log" Sep 16 13:42:29.068672 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.068648 2580 generic.go:356] "Generic (PLEG): container finished" podID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" containerID="72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed" exitCode=143 Sep 16 13:42:29.068758 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.068697 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:42:29.068758 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.068743 2580 scope.go:117] "RemoveContainer" containerID="72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed" Sep 16 13:42:29.070452 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:42:29.070427 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rkjfc\" is forbidden: User \"system:node:ip-10-0-137-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6lkjf\": no relationship found between node 'ip-10-0-137-26.ec2.internal' and this object" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:42:29.077329 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.077310 2580 scope.go:117] "RemoveContainer" containerID="7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a" Sep 16 13:42:29.078706 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:42:29.078683 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rkjfc\" is forbidden: User \"system:node:ip-10-0-137-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6lkjf\": no relationship found between node 'ip-10-0-137-26.ec2.internal' and this object" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" pod="openshift-must-gather-6lkjf/must-gather-rkjfc" Sep 16 13:42:29.089400 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.089382 2580 scope.go:117] "RemoveContainer" containerID="72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed" Sep 16 13:42:29.089669 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:42:29.089648 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed\": container with ID starting with 72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed not found: ID does not exist" containerID="72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed" Sep 16 13:42:29.089729 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.089675 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed"} err="failed to get container status \"72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed\": rpc error: code = NotFound desc = could not find container \"72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed\": container with ID starting with 72d22f8a05f67a54059da76b9f55069cf143ff5a6fca4bb3c02bbab5f9d9b9ed not found: ID does not exist" Sep 16 13:42:29.089729 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.089693 2580 scope.go:117] "RemoveContainer" containerID="7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a" Sep 16 13:42:29.089940 ip-10-0-137-26 kubenswrapper[2580]: E0916 13:42:29.089924 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a\": container with ID starting with 7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a not found: ID does not exist" containerID="7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a" Sep 16 13:42:29.089986 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.089945 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a"} err="failed to get container status \"7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a\": rpc error: code = NotFound desc = could not find container \"7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a\": container with ID starting with 7e0ac0590c4f4be5148648f69a01f505b5f9ca6612494edc13d2a6e7632bdf1a not found: ID does not exist" Sep 16 13:42:29.402049 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:29.402018 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" path="/var/lib/kubelet/pods/71953758-da4a-49e0-a3f4-d512c5f6f6ad/volumes" Sep 16 13:42:30.715663 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:30.715585 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-qngjg_6d40458f-6f54-4098-b0c4-11a5a069f6fc/cluster-monitoring-operator/0.log" Sep 16 13:42:31.017653 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.017627 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cvxpn_8f7dfda8-2577-46fe-a846-af647fb9467d/node-exporter/0.log" Sep 16 13:42:31.041606 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.041579 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cvxpn_8f7dfda8-2577-46fe-a846-af647fb9467d/kube-rbac-proxy/0.log" Sep 16 13:42:31.065999 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.065975 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cvxpn_8f7dfda8-2577-46fe-a846-af647fb9467d/init-textfile/0.log" Sep 16 13:42:31.213637 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.213608 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-ffx9k_b93070a0-0e10-4c49-bddb-5dfa61da4a46/kube-rbac-proxy-main/0.log" Sep 16 13:42:31.258092 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.258012 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-ffx9k_b93070a0-0e10-4c49-bddb-5dfa61da4a46/kube-rbac-proxy-self/0.log" Sep 16 13:42:31.284320 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.284293 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-ffx9k_b93070a0-0e10-4c49-bddb-5dfa61da4a46/openshift-state-metrics/0.log" Sep 16 13:42:31.326403 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.326378 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5892543e-ca0f-48dd-b569-d0e13354c27b/prometheus/0.log" Sep 16 13:42:31.342520 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.342494 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5892543e-ca0f-48dd-b569-d0e13354c27b/config-reloader/0.log" Sep 16 13:42:31.363038 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.363015 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5892543e-ca0f-48dd-b569-d0e13354c27b/thanos-sidecar/0.log" Sep 16 13:42:31.388441 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.388418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5892543e-ca0f-48dd-b569-d0e13354c27b/kube-rbac-proxy-web/0.log" Sep 16 13:42:31.417139 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.417114 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5892543e-ca0f-48dd-b569-d0e13354c27b/kube-rbac-proxy/0.log" Sep 16 13:42:31.441328 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.441306 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5892543e-ca0f-48dd-b569-d0e13354c27b/kube-rbac-proxy-thanos/0.log" Sep 16 13:42:31.464135 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.464117 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5892543e-ca0f-48dd-b569-d0e13354c27b/init-config-reloader/0.log" Sep 16 13:42:31.664900 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.664863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5779b857d6-btqhk_692d29f3-089f-493f-8094-1b750dd1fa82/thanos-query/0.log" Sep 16 13:42:31.688071 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.688037 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5779b857d6-btqhk_692d29f3-089f-493f-8094-1b750dd1fa82/kube-rbac-proxy-web/0.log" Sep 16 13:42:31.711658 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.711638 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5779b857d6-btqhk_692d29f3-089f-493f-8094-1b750dd1fa82/kube-rbac-proxy/0.log" Sep 16 13:42:31.734157 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.734134 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5779b857d6-btqhk_692d29f3-089f-493f-8094-1b750dd1fa82/prom-label-proxy/0.log" Sep 16 13:42:31.760449 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.760426 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5779b857d6-btqhk_692d29f3-089f-493f-8094-1b750dd1fa82/kube-rbac-proxy-rules/0.log" Sep 16 13:42:31.779657 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:31.779640 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5779b857d6-btqhk_692d29f3-089f-493f-8094-1b750dd1fa82/kube-rbac-proxy-metrics/0.log" Sep 16 13:42:32.984431 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:32.984346 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-lnmz5_d7283f56-7b7f-4389-a6bf-50f42a89df26/networking-console-plugin/0.log" Sep 16 13:42:34.408006 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.407976 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-968j2_672bd470-9bc1-44f2-b42b-aa861ff950be/volume-data-source-validator/0.log" Sep 16 13:42:34.510479 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.510451 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h"] Sep 16 13:42:34.510754 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.510742 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" containerName="copy" Sep 16 13:42:34.510754 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.510754 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" containerName="copy" Sep 16 13:42:34.510835 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.510771 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" containerName="gather" Sep 16 13:42:34.510835 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.510777 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" containerName="gather" Sep 16 13:42:34.510835 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.510825 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" containerName="copy" Sep 16 13:42:34.510835 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.510835 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71953758-da4a-49e0-a3f4-d512c5f6f6ad" containerName="gather" Sep 16 13:42:34.514983 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.514964 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.517025 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.517004 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-svrn2\"/\"default-dockercfg-prqsv\"" Sep 16 13:42:34.517025 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.517016 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-svrn2\"/\"openshift-service-ca.crt\"" Sep 16 13:42:34.517519 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.517494 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-svrn2\"/\"kube-root-ca.crt\"" Sep 16 13:42:34.522098 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.522078 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h"] Sep 16 13:42:34.657502 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.657469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-sys\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.657677 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.657516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-lib-modules\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.657677 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.657558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-proc\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.657677 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.657590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-podres\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.657677 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.657615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spkbn\" (UniqueName: \"kubernetes.io/projected/27caece4-fb68-45db-bacc-90495038d1ce-kube-api-access-spkbn\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.758353 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.758278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-lib-modules\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.758353 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.758325 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-proc\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.758564 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.758444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-podres\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.758564 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.758471 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-proc\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.758564 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.758449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-lib-modules\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.758564 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.758496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spkbn\" (UniqueName: \"kubernetes.io/projected/27caece4-fb68-45db-bacc-90495038d1ce-kube-api-access-spkbn\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.758564 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.758507 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-podres\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.758775 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.758565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-sys\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.758775 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.758653 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27caece4-fb68-45db-bacc-90495038d1ce-sys\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.766450 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.766431 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spkbn\" (UniqueName: \"kubernetes.io/projected/27caece4-fb68-45db-bacc-90495038d1ce-kube-api-access-spkbn\") pod \"perf-node-gather-daemonset-slw7h\" (UID: \"27caece4-fb68-45db-bacc-90495038d1ce\") " pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:34.825151 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:34.825116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:35.093567 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:35.093534 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h"] Sep 16 13:42:35.096388 ip-10-0-137-26 kubenswrapper[2580]: W0916 13:42:35.096355 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27caece4_fb68_45db_bacc_90495038d1ce.slice/crio-e1912c37e70b8bb44b5a181e955ee85a56326dc6b2d9ca34cba18814acf36a8d WatchSource:0}: Error finding container e1912c37e70b8bb44b5a181e955ee85a56326dc6b2d9ca34cba18814acf36a8d: Status 404 returned error can't find the container with id e1912c37e70b8bb44b5a181e955ee85a56326dc6b2d9ca34cba18814acf36a8d Sep 16 13:42:35.326975 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:35.326945 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-52rdp_a0054dc8-ac6f-4632-a637-68ba44d9aeae/dns/0.log" Sep 16 13:42:35.345828 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:35.345753 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-52rdp_a0054dc8-ac6f-4632-a637-68ba44d9aeae/kube-rbac-proxy/0.log" Sep 16 13:42:35.480717 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:35.480691 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ssrrq_a69a0931-4858-4609-85df-062a0d799e1a/dns-node-resolver/0.log" Sep 16 13:42:35.938593 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:35.938566 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-558fd7566b-zjgxb_34276f03-0953-427a-852d-b59f2401c378/registry/0.log" Sep 16 13:42:35.987194 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:35.987164 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k942t_f2964d87-4632-4930-a87c-0cafa4154548/node-ca/0.log" Sep 16 13:42:36.097624 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:36.097579 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" event={"ID":"27caece4-fb68-45db-bacc-90495038d1ce","Type":"ContainerStarted","Data":"c0fdb55b6079ad7c135d05fd434248c7d6f29977f6915eb62f5c2eff3fa021bd"} Sep 16 13:42:36.097841 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:36.097638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" event={"ID":"27caece4-fb68-45db-bacc-90495038d1ce","Type":"ContainerStarted","Data":"e1912c37e70b8bb44b5a181e955ee85a56326dc6b2d9ca34cba18814acf36a8d"} Sep 16 13:42:36.097841 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:36.097677 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:36.114435 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:36.114388 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" podStartSLOduration=2.114370962 podStartE2EDuration="2.114370962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:42:36.112747927 +0000 UTC m=+3279.171256840" watchObservedRunningTime="2026-09-16 13:42:36.114370962 +0000 UTC m=+3279.172879871" Sep 16 13:42:37.059464 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:37.059434 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bg2ml_8713b81d-6d5f-4a95-8d12-71c32c6b8c30/serve-healthcheck-canary/0.log" Sep 16 13:42:37.416685 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:37.416655 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-28v7h_1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f/insights-operator/0.log" Sep 16 13:42:37.417661 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:37.417633 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-28v7h_1f4e0b2c-7586-4ee1-8d8e-4b155fcc331f/insights-operator/1.log" Sep 16 13:42:37.438007 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:37.437980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-52pvf_9117830d-0c23-4e22-9bc6-733fa9610397/kube-rbac-proxy/0.log" Sep 16 13:42:37.457564 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:37.457543 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-52pvf_9117830d-0c23-4e22-9bc6-733fa9610397/exporter/0.log" Sep 16 13:42:37.476861 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:37.476815 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-52pvf_9117830d-0c23-4e22-9bc6-733fa9610397/extractor/0.log" Sep 16 13:42:39.836909 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:39.836882 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-v8hnf_36ff74f6-afcf-41cd-8e2a-8eb4009e4957/manager/0.log" Sep 16 13:42:40.031377 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:40.031351 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-rp6cg_0154786f-7288-4406-adb3-adceab91cbe8/s3-init/0.log" Sep 16 13:42:40.047234 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:40.047208 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-rp6cg_0154786f-7288-4406-adb3-adceab91cbe8/download-hf-model/0.log" Sep 16 13:42:42.111547 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:42.111520 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-svrn2/perf-node-gather-daemonset-slw7h" Sep 16 13:42:45.378682 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.378658 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmjfb_6480cf31-d326-49b5-9689-94759091a386/kube-multus-additional-cni-plugins/0.log" Sep 16 13:42:45.399805 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.399782 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmjfb_6480cf31-d326-49b5-9689-94759091a386/egress-router-binary-copy/0.log" Sep 16 13:42:45.420242 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.420222 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmjfb_6480cf31-d326-49b5-9689-94759091a386/cni-plugins/0.log" Sep 16 13:42:45.442372 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.442347 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmjfb_6480cf31-d326-49b5-9689-94759091a386/bond-cni-plugin/0.log" Sep 16 13:42:45.472267 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.472247 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmjfb_6480cf31-d326-49b5-9689-94759091a386/routeoverride-cni/0.log" Sep 16 13:42:45.494515 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.494498 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmjfb_6480cf31-d326-49b5-9689-94759091a386/whereabouts-cni-bincopy/0.log" Sep 16 13:42:45.520004 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.519983 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tmjfb_6480cf31-d326-49b5-9689-94759091a386/whereabouts-cni/0.log" Sep 16 13:42:45.766272 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.766204 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xvwcv_9c9ad48b-5f4c-4a69-bb79-5a1af5918a10/kube-multus/0.log" Sep 16 13:42:45.861039 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.861011 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ltwsm_41775133-5324-474c-9c12-645b149e7113/network-metrics-daemon/0.log" Sep 16 13:42:45.880926 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:45.880871 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ltwsm_41775133-5324-474c-9c12-645b149e7113/kube-rbac-proxy/0.log" Sep 16 13:42:46.550726 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:46.550698 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6ccb_2216d776-a5c5-4488-8d66-cf721d1b3f5b/ovn-controller/0.log" Sep 16 13:42:46.568182 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:46.568158 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6ccb_2216d776-a5c5-4488-8d66-cf721d1b3f5b/ovn-acl-logging/0.log" Sep 16 13:42:46.589174 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:46.589144 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6ccb_2216d776-a5c5-4488-8d66-cf721d1b3f5b/kube-rbac-proxy-node/0.log" Sep 16 13:42:46.614209 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:46.614189 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6ccb_2216d776-a5c5-4488-8d66-cf721d1b3f5b/kube-rbac-proxy-ovn-metrics/0.log" Sep 16 13:42:46.630766 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:46.630750 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6ccb_2216d776-a5c5-4488-8d66-cf721d1b3f5b/northd/0.log" Sep 16 13:42:46.649181 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:46.649156 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6ccb_2216d776-a5c5-4488-8d66-cf721d1b3f5b/nbdb/0.log" Sep 16 13:42:46.669689 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:46.669674 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6ccb_2216d776-a5c5-4488-8d66-cf721d1b3f5b/sbdb/0.log" Sep 16 13:42:46.703329 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:46.703310 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k6ccb_2216d776-a5c5-4488-8d66-cf721d1b3f5b/ovnkube-controller/0.log" Sep 16 13:42:48.224897 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:48.224867 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qsbrp_5d997e5a-fd8b-49a0-8264-12e773951182/network-check-target-container/0.log" Sep 16 13:42:49.082362 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:49.082335 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-59nfp_4b5af094-de84-470d-b07b-5be03e6277a6/iptables-alerter/0.log" Sep 16 13:42:49.707108 ip-10-0-137-26 kubenswrapper[2580]: I0916 13:42:49.707080 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hpm2d_cbf8c1e2-c807-4d5c-90d5-aa46a1020650/tuned/0.log"