Sep 17 17:32:25.287098 ip-10-0-138-116 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 17:32:25.287112 ip-10-0-138-116 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 17:32:25.287121 ip-10-0-138-116 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 17:32:25.287336 ip-10-0-138-116 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 17:32:36.582022 ip-10-0-138-116 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 17:32:36.582038 ip-10-0-138-116 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 77746ad0417c425f911a9af708b2da05 -- Sep 17 17:34:39.979926 ip-10-0-138-116 systemd[1]: Starting Kubernetes Kubelet... Sep 17 17:34:43.529594 ip-10-0-138-116 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:34:43.529594 ip-10-0-138-116 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 17:34:43.529594 ip-10-0-138-116 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:34:43.529594 ip-10-0-138-116 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 17:34:43.529594 ip-10-0-138-116 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:34:43.530470 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.529671 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 17:34:43.533331 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533312 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:43.533331 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533329 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:43.533331 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533333 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533337 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533340 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533343 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533346 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533349 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533358 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533361 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533365 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533368 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533371 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533374 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533376 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533380 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533383 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533386 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533388 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533391 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533396 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:43.533427 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533400 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533403 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533407 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533410 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533413 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533416 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533419 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533422 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533425 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533428 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533432 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533436 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533439 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533442 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533445 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533450 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533455 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533458 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533461 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533464 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:43.533981 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533468 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533472 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533475 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533478 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533480 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533483 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533486 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533489 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533491 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533494 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533497 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533500 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533502 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533505 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533509 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533512 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533515 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533518 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533521 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533523 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:43.534521 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533526 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533529 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533532 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533534 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533537 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533542 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533544 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533547 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533561 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533564 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533568 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533571 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533573 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533576 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533579 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533582 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533585 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533587 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533590 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533593 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:43.535059 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533596 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533599 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533602 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533605 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533607 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533610 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533614 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533617 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533621 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533623 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533626 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533629 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533632 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533635 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533638 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533641 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533643 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.533646 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534384 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534390 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:43.535608 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534394 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534397 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534400 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534403 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534406 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534409 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534412 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534415 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534418 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534421 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534424 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534427 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534430 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534433 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534435 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534438 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534441 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534444 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534448 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534451 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:43.536125 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534454 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534456 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534459 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534462 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534465 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534467 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534472 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534476 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534480 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534483 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534486 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534489 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534492 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534495 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534498 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534501 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534504 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534507 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534509 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534512 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:43.536729 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534515 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534519 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534522 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534525 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534528 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534531 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534534 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534537 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534540 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534542 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534546 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534564 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534568 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534571 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534574 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534576 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534579 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534583 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534587 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:43.537261 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534590 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534594 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534597 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534600 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534604 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534607 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534610 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534614 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534617 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534620 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534623 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534626 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534629 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534633 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534636 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534640 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534642 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534645 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534648 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:43.537793 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534651 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534654 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534657 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534659 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534664 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534667 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534670 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534673 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534676 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534679 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534681 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534684 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534687 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534690 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534693 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534695 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534698 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534701 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.534704 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535095 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:43.538310 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535100 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535103 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535106 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535110 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535113 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535116 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535118 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535121 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535124 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535127 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535130 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535133 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535135 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535138 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535141 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535144 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535150 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535153 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535155 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535158 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:43.538861 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535161 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535164 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535167 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535169 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535172 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535175 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535178 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535180 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535185 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535189 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535192 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535195 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535198 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535201 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535204 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535207 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535210 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535213 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535216 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:43.539432 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535219 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535221 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535224 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535227 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535230 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535232 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535235 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535240 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535243 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535249 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535252 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535255 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535258 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535261 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535264 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535267 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535269 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535274 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535277 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:43.539929 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535280 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535282 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535285 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535288 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535291 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535293 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535296 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535299 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535302 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535304 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535307 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535310 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535313 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535316 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535319 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535322 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535324 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535328 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535331 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535333 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:43.540469 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535336 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535339 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535344 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535347 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535349 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535352 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535355 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535358 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535360 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535363 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535366 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535368 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535372 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535376 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535379 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535382 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535385 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535387 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535390 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.535393 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535466 2562 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 17:34:43.541008 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535499 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535516 2562 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535521 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535527 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535530 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535535 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535540 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535544 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535547 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535566 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535570 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535573 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535577 2562 flags.go:64] FLAG: --cgroup-root="" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535582 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535586 2562 flags.go:64] FLAG: --client-ca-file="" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535589 2562 flags.go:64] FLAG: --cloud-provider="external" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535593 2562 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535598 2562 flags.go:64] FLAG: --cluster-domain="" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535601 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535604 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535608 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535612 2562 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535616 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 17:34:43.541562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535619 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535623 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535627 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535630 2562 flags.go:64] FLAG: --contention-profiling="false" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535633 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535637 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535641 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535644 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535649 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535652 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535655 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535658 2562 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535662 2562 flags.go:64] FLAG: --enable-server="true" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535666 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535670 2562 flags.go:64] FLAG: --event-burst="100" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535674 2562 flags.go:64] FLAG: --event-qps="50" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535677 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535680 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535683 2562 flags.go:64] FLAG: --eviction-hard="" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535687 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535690 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535694 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535699 2562 flags.go:64] FLAG: --eviction-soft="" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535702 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535705 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 17:34:43.542146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535708 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535712 2562 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535715 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535718 2562 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535721 2562 flags.go:64] FLAG: --feature-gates="" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535725 2562 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535729 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535732 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535736 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535739 2562 flags.go:64] FLAG: --healthz-port="10248" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535742 2562 flags.go:64] FLAG: --help="false" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535745 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535749 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535752 2562 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535756 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535760 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535763 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535767 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535770 2562 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535773 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535776 2562 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535780 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535783 2562 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535786 2562 flags.go:64] FLAG: --kube-reserved="" Sep 17 17:34:43.542898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535797 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535800 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535804 2562 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535807 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535811 2562 flags.go:64] FLAG: --lock-file="" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535816 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535819 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535822 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535834 2562 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535837 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535840 2562 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535843 2562 flags.go:64] FLAG: --logging-format="text" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535847 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535851 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535854 2562 flags.go:64] FLAG: --manifest-url="" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535857 2562 flags.go:64] FLAG: --manifest-url-header="" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535862 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535865 2562 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535869 2562 flags.go:64] FLAG: --max-pods="110" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535873 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535876 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535880 2562 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535884 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535887 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535891 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 17:34:43.543534 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535894 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535901 2562 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535904 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535907 2562 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535911 2562 flags.go:64] FLAG: --pod-cidr="" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535914 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535920 2562 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535923 2562 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535927 2562 flags.go:64] FLAG: --pods-per-core="0" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535930 2562 flags.go:64] FLAG: --port="10250" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535934 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535938 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-021c82c29b88c13fd" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535941 2562 flags.go:64] FLAG: --qos-reserved="" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535946 2562 flags.go:64] FLAG: --read-only-port="10255" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535949 2562 flags.go:64] FLAG: --register-node="true" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535953 2562 flags.go:64] FLAG: --register-with-taints="" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535957 2562 flags.go:64] FLAG: --registry-burst="10" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535960 2562 flags.go:64] FLAG: --registry-qps="5" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535963 2562 flags.go:64] FLAG: --reserved-cpus="" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535967 2562 flags.go:64] FLAG: --reserved-memory="" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535971 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535974 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535977 2562 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535981 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535984 2562 flags.go:64] FLAG: --runonce="false" Sep 17 17:34:43.544196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535987 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535990 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535994 2562 flags.go:64] FLAG: --seccomp-default="false" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.535997 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536000 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536004 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536007 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536011 2562 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536014 2562 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536017 2562 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536020 2562 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536023 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536027 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536030 2562 flags.go:64] FLAG: --system-cgroups="" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536033 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536039 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536043 2562 flags.go:64] FLAG: --tls-cert-file="" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536046 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536051 2562 flags.go:64] FLAG: --tls-min-version="" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536054 2562 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536060 2562 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536063 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536066 2562 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536070 2562 flags.go:64] FLAG: --v="2" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536074 2562 flags.go:64] FLAG: --version="false" Sep 17 17:34:43.544872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536079 2562 flags.go:64] FLAG: --vmodule="" Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536083 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.536086 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536204 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536209 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536212 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536215 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536218 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536222 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536228 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536231 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536234 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536238 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536243 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536246 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536249 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536252 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536255 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536258 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:43.545527 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536261 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536264 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536268 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536271 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536274 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536277 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536280 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536283 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536287 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536290 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536293 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536295 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536298 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536301 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536304 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536307 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536309 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536312 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536315 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536318 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:43.546054 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536320 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536323 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536327 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536332 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536336 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536339 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536342 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536345 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536348 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536351 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536354 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536356 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536359 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536362 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536365 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536368 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536371 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536374 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536377 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:43.546633 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536379 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536383 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536386 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536389 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536392 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536395 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536398 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536401 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536404 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536407 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536410 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536413 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536416 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536418 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536421 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536425 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536428 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536431 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536434 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536437 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:43.547138 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536440 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536442 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536445 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536448 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536451 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536454 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536457 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536460 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536462 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536466 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536469 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536472 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536474 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536479 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536482 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536485 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536488 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536491 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536494 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536497 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:43.547693 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536500 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536503 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536506 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.536508 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.537209 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.544194 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.544211 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.544232 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.544239 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544297 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544302 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544306 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544309 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544313 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544316 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:43.548207 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544319 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544322 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544325 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544328 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544332 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544335 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544338 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544341 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544344 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544347 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544350 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544353 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544356 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544359 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544362 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544365 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544368 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544371 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544374 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:43.548701 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544377 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544382 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544386 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544390 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544394 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544398 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544401 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544404 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544407 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544410 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544413 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544415 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544418 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544421 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544424 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544427 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544429 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544432 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544435 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:43.549208 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544438 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544441 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544444 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544447 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544450 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544452 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544455 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544458 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544461 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544464 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544466 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544469 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544474 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544477 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544481 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544484 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544487 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544491 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544495 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:43.549726 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544498 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544501 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544503 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544506 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544509 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544512 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544515 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544530 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544533 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544536 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544538 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544541 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544544 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544547 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544551 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544555 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544560 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544564 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544568 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544571 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:43.550256 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544574 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544577 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544580 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544583 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544586 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544589 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544592 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544595 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544597 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544600 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544604 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544608 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544612 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544616 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544618 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:43.550784 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544621 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.544627 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544766 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544772 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544775 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544779 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544782 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544786 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544789 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544792 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544795 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544798 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544803 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544807 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544810 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:43.551192 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544813 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544816 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544820 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544823 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544826 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544828 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544831 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544834 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544837 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544840 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544843 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544846 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544849 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544853 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544856 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544859 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544862 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544865 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544868 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544871 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:43.551599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544874 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544877 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544880 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544884 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544888 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544891 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544895 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544897 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544901 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544903 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544906 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544909 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544912 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544914 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544917 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544920 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544923 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544925 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544928 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544931 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:43.552417 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544934 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544937 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544940 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544943 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544946 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544950 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544954 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544958 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544961 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544964 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544967 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544970 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544973 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544975 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544978 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544981 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544984 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544986 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544989 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:43.553283 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544992 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544995 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.544997 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545000 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545003 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545006 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545009 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545012 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545015 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545018 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545020 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545023 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545026 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545032 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545035 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545038 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545041 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545044 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545047 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:43.553873 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545050 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545053 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545056 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545059 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545063 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545065 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545068 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:43.545071 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.545076 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.545190 2562 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.547725 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.548545 2562 server.go:1019] "Starting client certificate rotation" Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.548666 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:34:43.554377 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.548706 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:34:43.554752 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.551471 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:34:43.555131 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.555113 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:34:43.560009 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.559993 2562 log.go:25] "Validated CRI v1 runtime API" Sep 17 17:34:43.561801 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.561784 2562 log.go:25] "Validated CRI v1 image API" Sep 17 17:34:43.562675 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.562659 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 17:34:43.566028 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.566009 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ba413baa-f38b-4b63-9d3e-908c5862c34d:/dev/nvme0n1p3 fd252929-ab4a-4a23-bcbc-2948ee884fe3:/dev/nvme0n1p4] Sep 17 17:34:43.566089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.566026 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 17:34:43.570543 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.570431 2562 manager.go:216] Machine: {Timestamp:2026-09-17 17:34:43.569914543 +0000 UTC m=+2.019800666 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091688 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a15a29bf5779e84ca141d8711289b SystemUUID:ec2a15a2-9bf5-779e-84ca-141d8711289b BootID:77746ad0-417c-425f-911a-9af708b2da05 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d7:5b:05:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d7:5b:05:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:97:3e:86:a6:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 17:34:43.570543 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.570537 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 17:34:43.570666 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.570634 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 17:34:43.572139 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.572113 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 17:34:43.572313 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.572142 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 17:34:43.573511 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.573492 2562 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 17:34:43.573616 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.573515 2562 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 17:34:43.573616 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.573528 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:34:43.573616 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.573545 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:34:43.573766 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.573659 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 17:34:43.577411 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.577394 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:34:43.577572 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.577544 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 17:34:43.577647 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.577607 2562 kubelet.go:486] "Attempting to sync node with API server" Sep 17 17:34:43.577647 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.577624 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 17:34:43.577740 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.577648 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 17:34:43.577740 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.577661 2562 kubelet.go:398] "Adding apiserver pod source" Sep 17 17:34:43.577740 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.577676 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 17:34:43.578073 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.578058 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:34:43.578139 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.578082 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:34:43.580157 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.580134 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 17:34:43.583677 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.583644 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 17:34:43.583775 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.583712 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 17:34:43.584769 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584753 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 17:34:43.584835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584774 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 17:34:43.584835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584781 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 17:34:43.584835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584787 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 17:34:43.584835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584796 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 17:34:43.584835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584802 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 17:34:43.584835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584817 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 17:34:43.584835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584822 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 17:34:43.584835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584829 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 17:34:43.584835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584835 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 17:34:43.585117 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584850 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 17:34:43.585117 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584856 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 17:34:43.585117 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584882 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 17:34:43.585117 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.584887 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 17:34:43.588771 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.588755 2562 server.go:1268] "Started kubelet" Sep 17 17:34:43.588898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.588844 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 17:34:43.588961 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.588854 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 17:34:43.588961 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.588940 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 17:34:43.589793 ip-10-0-138-116 systemd[1]: Started Kubernetes Kubelet. Sep 17 17:34:43.590213 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.589906 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 17:34:43.590213 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.590128 2562 server.go:310] "Adding debug handlers to kubelet server" Sep 17 17:34:43.594120 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.594096 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 17:34:43.596326 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.596305 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 17:34:43.596420 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.596333 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 17:34:43.596420 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.596413 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:43.596860 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.596842 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 17:34:43.596860 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.596844 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 17:34:43.596995 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.596871 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 17:34:43.597051 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.597011 2562 reconstruct.go:97] "Volume reconstruction finished" Sep 17 17:34:43.597051 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.597020 2562 reconciler.go:29] "Reconciler: start to sync state" Sep 17 17:34:43.599366 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.599347 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 17:34:43.599442 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.599368 2562 factory.go:55] Registering systemd factory Sep 17 17:34:43.599442 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.599377 2562 factory.go:223] Registration of the systemd container factory successfully Sep 17 17:34:43.599698 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.599642 2562 factory.go:153] Registering CRI-O factory Sep 17 17:34:43.599698 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.599661 2562 factory.go:223] Registration of the crio container factory successfully Sep 17 17:34:43.599698 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.599680 2562 factory.go:103] Registering Raw factory Sep 17 17:34:43.599867 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.599706 2562 manager.go:1196] Started watching for new ooms in manager Sep 17 17:34:43.600093 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.600078 2562 manager.go:349] Starting recovery of all containers Sep 17 17:34:43.623497 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.623285 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 17:34:43.623615 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.623550 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 17:34:43.623615 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.623424 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 17:34:43.623748 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.623356 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 17:34:43.623748 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.623632 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 17:34:43.626754 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.626730 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:34:43.627738 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.627717 2562 manager.go:354] Recovery completed Sep 17 17:34:43.632464 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.632451 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:43.634636 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.634614 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:43.634723 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.634654 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:43.634723 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.634667 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:43.635277 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.635261 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 17:34:43.635277 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.635276 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 17:34:43.635403 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.635296 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:34:43.635403 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.635266 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:43.636084 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.636063 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:43.636176 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.636096 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:43.636176 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.636108 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:43.637801 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.637781 2562 policy_none.go:49] "None policy: Start" Sep 17 17:34:43.637878 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.637806 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 17:34:43.637878 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.637821 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 17:34:43.640004 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.639992 2562 policy_none.go:47] "Start" Sep 17 17:34:43.665774 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.665731 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bt4hg" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.678113 2562 manager.go:337] "Starting Device Plugin manager" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.678149 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.678162 2562 server.go:87] "Starting device plugin registration server" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.678420 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.678443 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.678572 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.678655 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.678662 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.679599 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.679661 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.645200 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-116.ec2.internal.18d62c2f4cba79ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-116.ec2.internal,UID:ip-10-0-138-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-116.ec2.internal,},FirstTimestamp:2026-09-17 17:34:43.588725164 +0000 UTC m=+2.038611288,LastTimestamp:2026-09-17 17:34:43.588725164 +0000 UTC m=+2.038611288,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-116.ec2.internal,}" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.684067 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-116.ec2.internal.18d62c2f4f7702f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-116.ec2.internal,UID:ip-10-0-138-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-116.ec2.internal,},FirstTimestamp:2026-09-17 17:34:43.634635505 +0000 UTC m=+2.084521628,LastTimestamp:2026-09-17 17:34:43.634635505 +0000 UTC m=+2.084521628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-116.ec2.internal,}" Sep 17 17:34:43.691333 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.685928 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bt4hg" Sep 17 17:34:43.746764 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.746732 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 17:34:43.747987 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.747966 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 17:34:43.748084 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.748015 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 17:34:43.748084 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.748037 2562 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 17:34:43.748084 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.748076 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 17:34:43.753547 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.753529 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:43.779170 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.779144 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:43.780170 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.780118 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:43.780170 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.780156 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:43.780170 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.780170 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:43.780319 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.780198 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.792663 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.792644 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.792714 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.792668 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-116.ec2.internal\": node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:43.848234 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.848201 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal"] Sep 17 17:34:43.848366 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.848278 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:43.849235 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.849220 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:43.849308 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.849251 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:43.849308 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.849269 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:43.851750 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.851736 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:43.851884 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.851870 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.851930 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.851903 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:43.852510 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.852482 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:43.852510 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.852513 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:43.852662 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.852529 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:43.852662 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.852555 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:43.852662 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.852580 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:43.852662 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.852596 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:43.854828 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.854810 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.854908 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.854837 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:43.855490 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.855454 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:43.855490 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.855486 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:43.855609 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.855498 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:43.877393 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.877371 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-116.ec2.internal\" not found" node="ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.882180 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.882163 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-116.ec2.internal\" not found" node="ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.898811 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.898785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f3b025cecd441286864e2d5f284fecf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal\" (UID: \"4f3b025cecd441286864e2d5f284fecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.898811 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.898809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/974c10c54eca630105f59e37102fa24a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-116.ec2.internal\" (UID: \"974c10c54eca630105f59e37102fa24a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.898945 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.898829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f3b025cecd441286864e2d5f284fecf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal\" (UID: \"4f3b025cecd441286864e2d5f284fecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.911713 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:43.911693 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:43.998991 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.998957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f3b025cecd441286864e2d5f284fecf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal\" (UID: \"4f3b025cecd441286864e2d5f284fecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.998991 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.998994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f3b025cecd441286864e2d5f284fecf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal\" (UID: \"4f3b025cecd441286864e2d5f284fecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.999197 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.999013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/974c10c54eca630105f59e37102fa24a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-116.ec2.internal\" (UID: \"974c10c54eca630105f59e37102fa24a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.999197 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.999041 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/974c10c54eca630105f59e37102fa24a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-116.ec2.internal\" (UID: \"974c10c54eca630105f59e37102fa24a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.999197 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.999077 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f3b025cecd441286864e2d5f284fecf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal\" (UID: \"4f3b025cecd441286864e2d5f284fecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" Sep 17 17:34:43.999197 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:43.999078 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f3b025cecd441286864e2d5f284fecf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal\" (UID: \"4f3b025cecd441286864e2d5f284fecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" Sep 17 17:34:44.011872 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.011850 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:44.112274 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.112194 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:44.184593 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.184546 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" Sep 17 17:34:44.185745 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.185726 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal" Sep 17 17:34:44.212782 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.212747 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:44.313138 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.313094 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:44.413411 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.413338 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:44.513548 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.513512 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:44.548399 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.548372 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 17:34:44.549055 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.548461 2562 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.138.116:50986->44.197.49.217:6443: use of closed network connection" Sep 17 17:34:44.549055 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.548538 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.138.116:50986->44.197.49.217:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 17:34:44.549055 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.548554 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 17:34:44.614286 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.614254 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:44.693220 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.693136 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:29:43 +0000 UTC" deadline="2028-07-04 08:37:51.13450906 +0000 UTC" Sep 17 17:34:44.693220 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.693180 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15735h3m6.441333057s" Sep 17 17:34:44.710590 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.710563 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:44.712314 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.712294 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:44.712430 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.712332 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:44.712430 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.712348 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:44.714604 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.714586 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:44.762848 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.762826 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:44.815603 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.815561 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:44.894337 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.894314 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:44.901385 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:44.901357 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3b025cecd441286864e2d5f284fecf.slice/crio-52e0080f92caab409c512d08163948e89a300352633870483d4130ca77f6ca89 WatchSource:0}: Error finding container 52e0080f92caab409c512d08163948e89a300352633870483d4130ca77f6ca89: Status 404 returned error can't find the container with id 52e0080f92caab409c512d08163948e89a300352633870483d4130ca77f6ca89 Sep 17 17:34:44.902098 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:44.902062 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod974c10c54eca630105f59e37102fa24a.slice/crio-b8a60857df6bc4a72f2ef46185c33253ea57ba007ca9937a293f95b540e0368e WatchSource:0}: Error finding container b8a60857df6bc4a72f2ef46185c33253ea57ba007ca9937a293f95b540e0368e: Status 404 returned error can't find the container with id b8a60857df6bc4a72f2ef46185c33253ea57ba007ca9937a293f95b540e0368e Sep 17 17:34:44.907755 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:44.907736 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:34:44.916623 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:44.916595 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.017476 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.017381 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.117855 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.117807 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.218116 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.218083 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.318586 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.318497 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.391826 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:45.391785 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:45.419381 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.419346 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.520406 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.520371 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.620629 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.620546 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.721217 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.721180 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.754578 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:45.754509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal" event={"ID":"974c10c54eca630105f59e37102fa24a","Type":"ContainerStarted","Data":"b8a60857df6bc4a72f2ef46185c33253ea57ba007ca9937a293f95b540e0368e"} Sep 17 17:34:45.756059 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:45.756031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" event={"ID":"4f3b025cecd441286864e2d5f284fecf","Type":"ContainerStarted","Data":"52e0080f92caab409c512d08163948e89a300352633870483d4130ca77f6ca89"} Sep 17 17:34:45.821753 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.821694 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:45.922457 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:45.922373 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:46.022797 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.022758 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:46.123560 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.123522 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:46.224123 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.224051 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:46.324581 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.324541 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:46.425095 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.425064 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-116.ec2.internal\" not found" Sep 17 17:34:46.451885 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.451856 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:46.496962 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.496897 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" Sep 17 17:34:46.509253 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.509233 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:34:46.510070 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.510056 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal" Sep 17 17:34:46.520934 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.520910 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:34:46.580333 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.580305 2562 apiserver.go:52] "Watching apiserver" Sep 17 17:34:46.586181 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.586152 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 17:34:46.586620 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.586596 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-xsx7m","openshift-multus/network-metrics-daemon-6ntvh","openshift-network-operator/iptables-alerter-jwf54","kube-system/global-pull-secret-syncer-ftr75","kube-system/konnectivity-agent-npk2q","kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal","openshift-network-diagnostics/network-check-target-5zfnp","openshift-ovn-kubernetes/ovnkube-node-8hxld","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7","openshift-cluster-node-tuning-operator/tuned-hsm52","openshift-image-registry/node-ca-6fm4h","openshift-multus/multus-additional-cni-plugins-2mx2t"] Sep 17 17:34:46.589225 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.589203 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.591402 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.591379 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:46.591514 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.591466 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:34:46.592194 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.592012 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 17:34:46.592194 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.592018 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r2m68\"" Sep 17 17:34:46.592194 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.592020 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 17:34:46.592194 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.592014 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:34:46.593630 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.593611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.595688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.595661 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7ws8d\"" Sep 17 17:34:46.596415 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.596353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:46.596537 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.596487 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:34:46.596601 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.596589 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 17:34:46.596660 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.596609 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 17:34:46.597095 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.597072 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 17:34:46.598300 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.598282 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 17:34:46.599111 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.599097 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:34:46.601710 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.601693 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4r7lt\"" Sep 17 17:34:46.601805 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.601735 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 17:34:46.602278 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.602257 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 17:34:46.603136 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.603120 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:46.603232 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.603189 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:34:46.605428 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.605412 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.607728 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.607707 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.609237 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.609102 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 17:34:46.609237 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.609132 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d8qj5\"" Sep 17 17:34:46.609237 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.609218 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 17:34:46.609428 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.609256 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 17:34:46.609998 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.609982 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fpbpx\"" Sep 17 17:34:46.610129 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.610030 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.610240 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.610224 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 17:34:46.610604 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.610586 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 17:34:46.610604 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.610597 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 17:34:46.610742 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.610601 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 17:34:46.610914 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.610896 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 17:34:46.611621 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.611601 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 17:34:46.611723 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.611607 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 17:34:46.612974 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.612723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.613420 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.613375 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dw7vm\"" Sep 17 17:34:46.613666 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.613541 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 17:34:46.613762 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.613705 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:34:46.614023 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614006 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3579b563-b205-42d8-86f3-bfb21d947ace-host-slash\") pod \"iptables-alerter-jwf54\" (UID: \"3579b563-b205-42d8-86f3-bfb21d947ace\") " pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.614085 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-etc-selinux\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.614085 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-sys-fs\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.614085 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614074 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33b72a7d-7b44-46e7-af04-08d01670bb35-agent-certs\") pod \"konnectivity-agent-npk2q\" (UID: \"33b72a7d-7b44-46e7-af04-08d01670bb35\") " pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:34:46.614215 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33b72a7d-7b44-46e7-af04-08d01670bb35-konnectivity-ca\") pod \"konnectivity-agent-npk2q\" (UID: \"33b72a7d-7b44-46e7-af04-08d01670bb35\") " pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:34:46.614215 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3579b563-b205-42d8-86f3-bfb21d947ace-iptables-alerter-script\") pod \"iptables-alerter-jwf54\" (UID: \"3579b563-b205-42d8-86f3-bfb21d947ace\") " pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.614292 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-dbus\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:46.614292 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-registration-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.614292 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-device-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.614292 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-kubelet-config\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:46.614497 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:46.614497 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sldjh\" (UniqueName: \"kubernetes.io/projected/d1d6a361-a950-4168-930c-94b5065fac6f-kube-api-access-sldjh\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.614497 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69knv\" (UniqueName: \"kubernetes.io/projected/3579b563-b205-42d8-86f3-bfb21d947ace-kube-api-access-69knv\") pod \"iptables-alerter-jwf54\" (UID: \"3579b563-b205-42d8-86f3-bfb21d947ace\") " pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.614497 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:46.614497 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.614710 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-socket-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.614990 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614973 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 17:34:46.615102 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.614993 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 17:34:46.615167 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.615152 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.615338 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.615314 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 17:34:46.615427 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.615314 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-px5tz\"" Sep 17 17:34:46.618298 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.618280 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 17:34:46.618379 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.618314 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 17:34:46.618379 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.618346 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6n86b\"" Sep 17 17:34:46.626076 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.626054 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:34:46.650632 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.650613 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9kn5v" Sep 17 17:34:46.662913 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.662892 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9kn5v" Sep 17 17:34:46.698384 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.698351 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 17:34:46.715642 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3579b563-b205-42d8-86f3-bfb21d947ace-host-slash\") pod \"iptables-alerter-jwf54\" (UID: \"3579b563-b205-42d8-86f3-bfb21d947ace\") " pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.715802 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-etc-selinux\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.715802 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.715802 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-socket-dir-parent\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.715802 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715721 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3579b563-b205-42d8-86f3-bfb21d947ace-host-slash\") pod \"iptables-alerter-jwf54\" (UID: \"3579b563-b205-42d8-86f3-bfb21d947ace\") " pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.715802 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-run-netns\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.715802 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-sysctl-conf\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqmjr\" (UniqueName: \"kubernetes.io/projected/9b7c7317-0809-4f38-8acb-709a2f66913f-kube-api-access-zqmjr\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715812 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-etc-selinux\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-cnibin\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-var-lib-cni-multus\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-cni-bin\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-cni-netd\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-sysconfig\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrjx9\" (UniqueName: \"kubernetes.io/projected/62b695b7-eb68-45ac-8407-7f213aa2a087-kube-api-access-rrjx9\") pod \"node-ca-6fm4h\" (UID: \"62b695b7-eb68-45ac-8407-7f213aa2a087\") " pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.715997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-kubelet-config\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-run-openvswitch\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.716092 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716080 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-kubelet-config\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sldjh\" (UniqueName: \"kubernetes.io/projected/d1d6a361-a950-4168-930c-94b5065fac6f-kube-api-access-sldjh\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-socket-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-var-lib-openvswitch\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wcng\" (UniqueName: \"kubernetes.io/projected/08daf89f-358d-4053-85a7-7394070be216-kube-api-access-6wcng\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716234 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-cni-dir\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-conf-dir\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-etc-kubernetes\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-host\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-kubernetes\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716371 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-run\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716405 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-socket-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-run-systemd\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-system-cni-dir\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.716542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-var-lib-kubelet\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-var-lib-kubelet\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-kubelet\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-slash\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-run-netns\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08daf89f-358d-4053-85a7-7394070be216-ovn-node-metrics-cert\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-run-multus-certs\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-sysctl-d\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-tmp\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33b72a7d-7b44-46e7-af04-08d01670bb35-agent-certs\") pod \"konnectivity-agent-npk2q\" (UID: \"33b72a7d-7b44-46e7-af04-08d01670bb35\") " pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-run-ovn\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08daf89f-358d-4053-85a7-7394070be216-ovnkube-script-lib\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-cni-binary-copy\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-tuned\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-var-lib-cni-bin\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3579b563-b205-42d8-86f3-bfb21d947ace-iptables-alerter-script\") pod \"iptables-alerter-jwf54\" (UID: \"3579b563-b205-42d8-86f3-bfb21d947ace\") " pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.717244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-log-socket\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/62b695b7-eb68-45ac-8407-7f213aa2a087-serviceca\") pod \"node-ca-6fm4h\" (UID: \"62b695b7-eb68-45ac-8407-7f213aa2a087\") " pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.716986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-registration-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717037 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-registration-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-hostroot\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdz6k\" (UniqueName: \"kubernetes.io/projected/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-kube-api-access-gdz6k\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.717094 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-system-cni-dir\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5zhd\" (UniqueName: \"kubernetes.io/projected/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-kube-api-access-w5zhd\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.717167 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret podName:3bacd02a-d64e-47c1-9a67-fe506b86dc0c nodeName:}" failed. No retries permitted until 2026-09-17 17:34:47.217130361 +0000 UTC m=+5.667016468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret") pod "global-pull-secret-syncer-ftr75" (UID: "3bacd02a-d64e-47c1-9a67-fe506b86dc0c") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69knv\" (UniqueName: \"kubernetes.io/projected/3579b563-b205-42d8-86f3-bfb21d947ace-kube-api-access-69knv\") pod \"iptables-alerter-jwf54\" (UID: \"3579b563-b205-42d8-86f3-bfb21d947ace\") " pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717186 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-systemd-units\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.718050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08daf89f-358d-4053-85a7-7394070be216-ovnkube-config\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-cnibin\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-daemon-config\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717434 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-sys-fs\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33b72a7d-7b44-46e7-af04-08d01670bb35-konnectivity-ca\") pod \"konnectivity-agent-npk2q\" (UID: \"33b72a7d-7b44-46e7-af04-08d01670bb35\") " pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717562 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3579b563-b205-42d8-86f3-bfb21d947ace-iptables-alerter-script\") pod \"iptables-alerter-jwf54\" (UID: \"3579b563-b205-42d8-86f3-bfb21d947ace\") " pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-dbus\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717588 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-sys-fs\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqkw9\" (UniqueName: \"kubernetes.io/projected/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-kube-api-access-bqkw9\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-systemd\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-sys\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-lib-modules\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-device-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717721 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-dbus\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-etc-openvswitch\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.718580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717778 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d1d6a361-a950-4168-930c-94b5065fac6f-device-dir\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.719129 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717806 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-run-k8s-cni-cncf-io\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.719129 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717831 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-modprobe-d\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.719129 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62b695b7-eb68-45ac-8407-7f213aa2a087-host\") pod \"node-ca-6fm4h\" (UID: \"62b695b7-eb68-45ac-8407-7f213aa2a087\") " pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.719129 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.719129 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-node-log\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.719129 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.717923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08daf89f-358d-4053-85a7-7394070be216-env-overrides\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.719129 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.718114 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33b72a7d-7b44-46e7-af04-08d01670bb35-konnectivity-ca\") pod \"konnectivity-agent-npk2q\" (UID: \"33b72a7d-7b44-46e7-af04-08d01670bb35\") " pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:34:46.720684 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.720659 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33b72a7d-7b44-46e7-af04-08d01670bb35-agent-certs\") pod \"konnectivity-agent-npk2q\" (UID: \"33b72a7d-7b44-46e7-af04-08d01670bb35\") " pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:34:46.737386 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.737361 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69knv\" (UniqueName: \"kubernetes.io/projected/3579b563-b205-42d8-86f3-bfb21d947ace-kube-api-access-69knv\") pod \"iptables-alerter-jwf54\" (UID: \"3579b563-b205-42d8-86f3-bfb21d947ace\") " pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.737798 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.737773 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:46.737798 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.737793 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:46.737931 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.737804 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8g49t for pod openshift-network-diagnostics/network-check-target-5zfnp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:46.737931 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.737855 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t podName:3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:47.237837549 +0000 UTC m=+5.687723678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8g49t" (UniqueName: "kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t") pod "network-check-target-5zfnp" (UID: "3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:46.741042 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.741014 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sldjh\" (UniqueName: \"kubernetes.io/projected/d1d6a361-a950-4168-930c-94b5065fac6f-kube-api-access-sldjh\") pod \"aws-ebs-csi-driver-node-9r9d7\" (UID: \"d1d6a361-a950-4168-930c-94b5065fac6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.803513 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.803417 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-mbvzt"] Sep 17 17:34:46.807417 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.807391 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:46.809648 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.809624 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 17:34:46.809648 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.809640 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qqsk8\"" Sep 17 17:34:46.810288 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.810220 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 17:34:46.818322 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-run-openvswitch\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.818418 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.818418 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-var-lib-openvswitch\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.818561 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818411 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-run-openvswitch\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.818561 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818424 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-var-lib-openvswitch\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.818561 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wcng\" (UniqueName: \"kubernetes.io/projected/08daf89f-358d-4053-85a7-7394070be216-kube-api-access-6wcng\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.818561 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-cni-dir\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.818561 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-conf-dir\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-etc-kubernetes\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-host\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-kubernetes\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-run\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-run-systemd\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818730 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-host\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-system-cni-dir\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818781 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-var-lib-kubelet\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.818803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818790 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-system-cni-dir\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818807 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-var-lib-kubelet\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818838 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-kubernetes\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-kubelet\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818877 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-slash\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818888 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-run\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-run-netns\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818908 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08daf89f-358d-4053-85a7-7394070be216-ovn-node-metrics-cert\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.818969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-run-multus-certs\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-sysctl-d\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-tmp\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-run-ovn\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08daf89f-358d-4053-85a7-7394070be216-ovnkube-script-lib\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-cni-binary-copy\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-tuned\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-var-lib-cni-bin\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.819357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-log-socket\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819254 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-run-ovn\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/62b695b7-eb68-45ac-8407-7f213aa2a087-serviceca\") pod \"node-ca-6fm4h\" (UID: \"62b695b7-eb68-45ac-8407-7f213aa2a087\") " pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819286 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-run-multus-certs\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819295 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-hostroot\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdz6k\" (UniqueName: \"kubernetes.io/projected/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-kube-api-access-gdz6k\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-system-cni-dir\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819394 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-sysctl-d\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819394 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-var-lib-cni-bin\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819420 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-system-cni-dir\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819419 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819444 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-log-socket\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819453 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-hostroot\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819467 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-run-systemd\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819520 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-var-lib-kubelet\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5zhd\" (UniqueName: \"kubernetes.io/projected/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-kube-api-access-w5zhd\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819749 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-kubelet\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820096 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.819819 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:46.819870 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs podName:9b7c7317-0809-4f38-8acb-709a2f66913f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:47.319854042 +0000 UTC m=+5.769740162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs") pod "network-metrics-daemon-6ntvh" (UID: "9b7c7317-0809-4f38-8acb-709a2f66913f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819970 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/62b695b7-eb68-45ac-8407-7f213aa2a087-serviceca\") pod \"node-ca-6fm4h\" (UID: \"62b695b7-eb68-45ac-8407-7f213aa2a087\") " pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.819978 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08daf89f-358d-4053-85a7-7394070be216-ovnkube-script-lib\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-systemd-units\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08daf89f-358d-4053-85a7-7394070be216-ovnkube-config\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-cnibin\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-daemon-config\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820222 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-var-lib-kubelet\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqkw9\" (UniqueName: \"kubernetes.io/projected/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-kube-api-access-bqkw9\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820279 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-run-netns\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-systemd\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-sys\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-lib-modules\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-cni-binary-copy\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-etc-openvswitch\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.820598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-run-k8s-cni-cncf-io\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820538 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-etc-kubernetes\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820574 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-slash\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-modprobe-d\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62b695b7-eb68-45ac-8407-7f213aa2a087-host\") pod \"node-ca-6fm4h\" (UID: \"62b695b7-eb68-45ac-8407-7f213aa2a087\") " pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820653 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-cni-dir\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-node-log\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820689 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820726 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62b695b7-eb68-45ac-8407-7f213aa2a087-host\") pod \"node-ca-6fm4h\" (UID: \"62b695b7-eb68-45ac-8407-7f213aa2a087\") " pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08daf89f-358d-4053-85a7-7394070be216-env-overrides\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820797 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08daf89f-358d-4053-85a7-7394070be216-ovnkube-config\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-socket-dir-parent\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820847 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-socket-dir-parent\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820608 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-conf-dir\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-run-netns\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-sysctl-conf\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.821089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqmjr\" (UniqueName: \"kubernetes.io/projected/9b7c7317-0809-4f38-8acb-709a2f66913f-kube-api-access-zqmjr\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-cnibin\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-var-lib-cni-multus\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.820976 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-cni-bin\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821045 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08daf89f-358d-4053-85a7-7394070be216-env-overrides\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-cni-netd\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-sysconfig\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821094 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-systemd\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrjx9\" (UniqueName: \"kubernetes.io/projected/62b695b7-eb68-45ac-8407-7f213aa2a087-kube-api-access-rrjx9\") pod \"node-ca-6fm4h\" (UID: \"62b695b7-eb68-45ac-8407-7f213aa2a087\") " pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821210 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-lib-modules\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821364 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-var-lib-cni-multus\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821411 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-cnibin\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821434 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821441 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-systemd-units\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821466 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-run-netns\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-host-run-k8s-cni-cncf-io\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821578 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-sysctl-conf\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.821818 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821582 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-node-log\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821614 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821659 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-cnibin\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821670 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-cni-bin\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821673 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-modprobe-d\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821245 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-etc-openvswitch\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821734 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-sysconfig\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821793 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08daf89f-358d-4053-85a7-7394070be216-host-cni-netd\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.821885 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-sys\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.822001 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08daf89f-358d-4053-85a7-7394070be216-ovn-node-metrics-cert\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.822181 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-tmp\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.822223 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-etc-tuned\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.822568 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.822448 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-multus-daemon-config\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.829946 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.829927 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5zhd\" (UniqueName: \"kubernetes.io/projected/8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5-kube-api-access-w5zhd\") pod \"multus-additional-cni-plugins-2mx2t\" (UID: \"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5\") " pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.833146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.833124 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrjx9\" (UniqueName: \"kubernetes.io/projected/62b695b7-eb68-45ac-8407-7f213aa2a087-kube-api-access-rrjx9\") pod \"node-ca-6fm4h\" (UID: \"62b695b7-eb68-45ac-8407-7f213aa2a087\") " pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.833542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.833523 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wcng\" (UniqueName: \"kubernetes.io/projected/08daf89f-358d-4053-85a7-7394070be216-kube-api-access-6wcng\") pod \"ovnkube-node-8hxld\" (UID: \"08daf89f-358d-4053-85a7-7394070be216\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.834609 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.834592 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqkw9\" (UniqueName: \"kubernetes.io/projected/ed4e9c2b-e3b2-41ee-8020-9058457dcf71-kube-api-access-bqkw9\") pod \"multus-xsx7m\" (UID: \"ed4e9c2b-e3b2-41ee-8020-9058457dcf71\") " pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.835274 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.835253 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqmjr\" (UniqueName: \"kubernetes.io/projected/9b7c7317-0809-4f38-8acb-709a2f66913f-kube-api-access-zqmjr\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:46.836529 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.836512 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdz6k\" (UniqueName: \"kubernetes.io/projected/bebbe153-c2af-43a2-8c8f-c93ce80ce9e2-kube-api-access-gdz6k\") pod \"tuned-hsm52\" (UID: \"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2\") " pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.902126 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.902107 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jwf54" Sep 17 17:34:46.911356 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.911332 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" Sep 17 17:34:46.916730 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.916706 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:34:46.922345 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.922230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwqwk\" (UniqueName: \"kubernetes.io/projected/34e63e2f-5e8b-410b-9df5-65e8686cd545-kube-api-access-wwqwk\") pod \"node-resolver-mbvzt\" (UID: \"34e63e2f-5e8b-410b-9df5-65e8686cd545\") " pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:46.922425 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.922372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34e63e2f-5e8b-410b-9df5-65e8686cd545-tmp-dir\") pod \"node-resolver-mbvzt\" (UID: \"34e63e2f-5e8b-410b-9df5-65e8686cd545\") " pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:46.922425 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.922392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34e63e2f-5e8b-410b-9df5-65e8686cd545-hosts-file\") pod \"node-resolver-mbvzt\" (UID: \"34e63e2f-5e8b-410b-9df5-65e8686cd545\") " pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:46.925311 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.925291 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hsm52" Sep 17 17:34:46.929393 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:46.929368 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d6a361_a950_4168_930c_94b5065fac6f.slice/crio-42e35db85256d3dfc2b3dfcb77750fa2e76b60ced727d7ea027c6f954bdcacf8 WatchSource:0}: Error finding container 42e35db85256d3dfc2b3dfcb77750fa2e76b60ced727d7ea027c6f954bdcacf8: Status 404 returned error can't find the container with id 42e35db85256d3dfc2b3dfcb77750fa2e76b60ced727d7ea027c6f954bdcacf8 Sep 17 17:34:46.929918 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:46.929850 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b72a7d_7b44_46e7_af04_08d01670bb35.slice/crio-c1308159b0d25e8efbbe0e3367521aedd395fe4dd173aeb17a78d372354295d1 WatchSource:0}: Error finding container c1308159b0d25e8efbbe0e3367521aedd395fe4dd173aeb17a78d372354295d1: Status 404 returned error can't find the container with id c1308159b0d25e8efbbe0e3367521aedd395fe4dd173aeb17a78d372354295d1 Sep 17 17:34:46.930682 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.930661 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:34:46.935540 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:46.935519 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebbe153_c2af_43a2_8c8f_c93ce80ce9e2.slice/crio-f3e788b295a1029d689880c6f3cee233ec277e98be3fe287a4c36c02e25843f4 WatchSource:0}: Error finding container f3e788b295a1029d689880c6f3cee233ec277e98be3fe287a4c36c02e25843f4: Status 404 returned error can't find the container with id f3e788b295a1029d689880c6f3cee233ec277e98be3fe287a4c36c02e25843f4 Sep 17 17:34:46.936703 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.936555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xsx7m" Sep 17 17:34:46.943406 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.943385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fm4h" Sep 17 17:34:46.944336 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:46.944315 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08daf89f_358d_4053_85a7_7394070be216.slice/crio-4d171b93b90f71ff84bc3ae3d36337b9a1a4890444199a9a2d8d896bbaecfb5f WatchSource:0}: Error finding container 4d171b93b90f71ff84bc3ae3d36337b9a1a4890444199a9a2d8d896bbaecfb5f: Status 404 returned error can't find the container with id 4d171b93b90f71ff84bc3ae3d36337b9a1a4890444199a9a2d8d896bbaecfb5f Sep 17 17:34:46.946567 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:46.946542 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4e9c2b_e3b2_41ee_8020_9058457dcf71.slice/crio-b08c474fb4718542113b201d780a09fbcd6b7286b10ff67f282473c03d1efaa0 WatchSource:0}: Error finding container b08c474fb4718542113b201d780a09fbcd6b7286b10ff67f282473c03d1efaa0: Status 404 returned error can't find the container with id b08c474fb4718542113b201d780a09fbcd6b7286b10ff67f282473c03d1efaa0 Sep 17 17:34:46.947074 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:46.947041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" Sep 17 17:34:46.954116 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:46.954093 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b695b7_eb68_45ac_8407_7f213aa2a087.slice/crio-c41401857708c36e4c0fc52242fabeb1918567de8688e6e0f6b934adc772ea01 WatchSource:0}: Error finding container c41401857708c36e4c0fc52242fabeb1918567de8688e6e0f6b934adc772ea01: Status 404 returned error can't find the container with id c41401857708c36e4c0fc52242fabeb1918567de8688e6e0f6b934adc772ea01 Sep 17 17:34:46.957141 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:46.957124 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4ef12c_6b2f_40c2_9bf7_ffe8836297c5.slice/crio-74e201c71db2b834dbd9019b1edbc0c57a203c6cd22946ee6212fd09c94d9b76 WatchSource:0}: Error finding container 74e201c71db2b834dbd9019b1edbc0c57a203c6cd22946ee6212fd09c94d9b76: Status 404 returned error can't find the container with id 74e201c71db2b834dbd9019b1edbc0c57a203c6cd22946ee6212fd09c94d9b76 Sep 17 17:34:47.023260 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.023230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwqwk\" (UniqueName: \"kubernetes.io/projected/34e63e2f-5e8b-410b-9df5-65e8686cd545-kube-api-access-wwqwk\") pod \"node-resolver-mbvzt\" (UID: \"34e63e2f-5e8b-410b-9df5-65e8686cd545\") " pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:47.023430 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.023340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34e63e2f-5e8b-410b-9df5-65e8686cd545-tmp-dir\") pod \"node-resolver-mbvzt\" (UID: \"34e63e2f-5e8b-410b-9df5-65e8686cd545\") " pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:47.023430 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.023361 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34e63e2f-5e8b-410b-9df5-65e8686cd545-hosts-file\") pod \"node-resolver-mbvzt\" (UID: \"34e63e2f-5e8b-410b-9df5-65e8686cd545\") " pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:47.023523 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.023453 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34e63e2f-5e8b-410b-9df5-65e8686cd545-hosts-file\") pod \"node-resolver-mbvzt\" (UID: \"34e63e2f-5e8b-410b-9df5-65e8686cd545\") " pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:47.023683 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.023664 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34e63e2f-5e8b-410b-9df5-65e8686cd545-tmp-dir\") pod \"node-resolver-mbvzt\" (UID: \"34e63e2f-5e8b-410b-9df5-65e8686cd545\") " pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:47.038988 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.038962 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwqwk\" (UniqueName: \"kubernetes.io/projected/34e63e2f-5e8b-410b-9df5-65e8686cd545-kube-api-access-wwqwk\") pod \"node-resolver-mbvzt\" (UID: \"34e63e2f-5e8b-410b-9df5-65e8686cd545\") " pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:47.118061 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.118038 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mbvzt" Sep 17 17:34:47.170270 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:34:47.170238 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e63e2f_5e8b_410b_9df5_65e8686cd545.slice/crio-f6edf6efe77242fd4c364489f2522420943617244d905e5f1a7241569f5491d4 WatchSource:0}: Error finding container f6edf6efe77242fd4c364489f2522420943617244d905e5f1a7241569f5491d4: Status 404 returned error can't find the container with id f6edf6efe77242fd4c364489f2522420943617244d905e5f1a7241569f5491d4 Sep 17 17:34:47.224765 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.224733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:47.224901 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:47.224881 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:47.224959 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:47.224950 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret podName:3bacd02a-d64e-47c1-9a67-fe506b86dc0c nodeName:}" failed. No retries permitted until 2026-09-17 17:34:48.22493357 +0000 UTC m=+6.674819682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret") pod "global-pull-secret-syncer-ftr75" (UID: "3bacd02a-d64e-47c1-9a67-fe506b86dc0c") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:47.326084 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.325977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:47.326232 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.326093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:47.326232 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:47.326135 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:47.326232 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:47.326214 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs podName:9b7c7317-0809-4f38-8acb-709a2f66913f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:48.326196313 +0000 UTC m=+6.776082423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs") pod "network-metrics-daemon-6ntvh" (UID: "9b7c7317-0809-4f38-8acb-709a2f66913f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:47.326395 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:47.326234 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:47.326395 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:47.326252 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:47.326395 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:47.326264 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8g49t for pod openshift-network-diagnostics/network-check-target-5zfnp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:47.326395 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:47.326320 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t podName:3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:48.326303863 +0000 UTC m=+6.776189985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8g49t" (UniqueName: "kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t") pod "network-check-target-5zfnp" (UID: "3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:47.666450 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.666345 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:46 +0000 UTC" deadline="2028-04-25 23:22:24.334261739 +0000 UTC" Sep 17 17:34:47.666450 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.666392 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14069h47m36.667874662s" Sep 17 17:34:47.752351 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.751586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:47.752351 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:47.751715 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:34:47.771413 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.771339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xsx7m" event={"ID":"ed4e9c2b-e3b2-41ee-8020-9058457dcf71","Type":"ContainerStarted","Data":"b08c474fb4718542113b201d780a09fbcd6b7286b10ff67f282473c03d1efaa0"} Sep 17 17:34:47.783206 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.783089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerStarted","Data":"4d171b93b90f71ff84bc3ae3d36337b9a1a4890444199a9a2d8d896bbaecfb5f"} Sep 17 17:34:47.787835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.787441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal" event={"ID":"974c10c54eca630105f59e37102fa24a","Type":"ContainerStarted","Data":"898443eb55b4376335202d1ad2f145e9141ae1490f3b1159c0658d0fb84c0aa4"} Sep 17 17:34:47.795493 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.795452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hsm52" event={"ID":"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2","Type":"ContainerStarted","Data":"f3e788b295a1029d689880c6f3cee233ec277e98be3fe287a4c36c02e25843f4"} Sep 17 17:34:47.798830 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.798790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-npk2q" event={"ID":"33b72a7d-7b44-46e7-af04-08d01670bb35","Type":"ContainerStarted","Data":"c1308159b0d25e8efbbe0e3367521aedd395fe4dd173aeb17a78d372354295d1"} Sep 17 17:34:47.812491 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.808602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" event={"ID":"d1d6a361-a950-4168-930c-94b5065fac6f","Type":"ContainerStarted","Data":"42e35db85256d3dfc2b3dfcb77750fa2e76b60ced727d7ea027c6f954bdcacf8"} Sep 17 17:34:47.812491 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.810791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jwf54" event={"ID":"3579b563-b205-42d8-86f3-bfb21d947ace","Type":"ContainerStarted","Data":"bc1844a2053eb9e77548df083f2c128dbcb88b329fe45622b79c87a6f34b9cc8"} Sep 17 17:34:47.818320 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.817720 2562 generic.go:356] "Generic (PLEG): container finished" podID="4f3b025cecd441286864e2d5f284fecf" containerID="03feb37108491bf58c590dbc49e974a72c111400bf7331d722f4bc269ba7b0ed" exitCode=0 Sep 17 17:34:47.818320 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.818009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" event={"ID":"4f3b025cecd441286864e2d5f284fecf","Type":"ContainerDied","Data":"03feb37108491bf58c590dbc49e974a72c111400bf7331d722f4bc269ba7b0ed"} Sep 17 17:34:47.822689 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.822626 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mbvzt" event={"ID":"34e63e2f-5e8b-410b-9df5-65e8686cd545","Type":"ContainerStarted","Data":"f6edf6efe77242fd4c364489f2522420943617244d905e5f1a7241569f5491d4"} Sep 17 17:34:47.830265 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.830229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" event={"ID":"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5","Type":"ContainerStarted","Data":"74e201c71db2b834dbd9019b1edbc0c57a203c6cd22946ee6212fd09c94d9b76"} Sep 17 17:34:47.836096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.836042 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fm4h" event={"ID":"62b695b7-eb68-45ac-8407-7f213aa2a087","Type":"ContainerStarted","Data":"c41401857708c36e4c0fc52242fabeb1918567de8688e6e0f6b934adc772ea01"} Sep 17 17:34:47.844961 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:47.843617 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-116.ec2.internal" podStartSLOduration=1.843600658 podStartE2EDuration="1.843600658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:47.81434338 +0000 UTC m=+6.264229514" watchObservedRunningTime="2026-09-17 17:34:47.843600658 +0000 UTC m=+6.293486785" Sep 17 17:34:48.235368 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:48.234855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:48.235368 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.235066 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:48.236196 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.236175 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret podName:3bacd02a-d64e-47c1-9a67-fe506b86dc0c nodeName:}" failed. No retries permitted until 2026-09-17 17:34:50.235113435 +0000 UTC m=+8.684999560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret") pod "global-pull-secret-syncer-ftr75" (UID: "3bacd02a-d64e-47c1-9a67-fe506b86dc0c") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:48.335486 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:48.335433 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:48.335657 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:48.335542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:48.335657 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.335624 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:48.335657 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.335654 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:48.335829 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.335714 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs podName:9b7c7317-0809-4f38-8acb-709a2f66913f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:50.335696213 +0000 UTC m=+8.785582327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs") pod "network-metrics-daemon-6ntvh" (UID: "9b7c7317-0809-4f38-8acb-709a2f66913f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:48.335829 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.335656 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:48.335829 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.335753 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8g49t for pod openshift-network-diagnostics/network-check-target-5zfnp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:48.335829 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.335813 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t podName:3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:50.335795857 +0000 UTC m=+8.785681970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8g49t" (UniqueName: "kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t") pod "network-check-target-5zfnp" (UID: "3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:48.667651 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:48.667505 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:46 +0000 UTC" deadline="2028-05-09 02:17:08.503336932 +0000 UTC" Sep 17 17:34:48.667651 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:48.667563 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14384h42m19.835777837s" Sep 17 17:34:48.749712 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:48.749119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:48.749712 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.749243 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:34:48.749712 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:48.749571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:48.749712 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:48.749675 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:34:48.857701 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:48.857623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" event={"ID":"4f3b025cecd441286864e2d5f284fecf","Type":"ContainerStarted","Data":"623e103f7fecc3f7ded5cb4e063525180c72bb92aa524d01b19c059f3091106f"} Sep 17 17:34:49.749629 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:49.749594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:49.750048 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:49.749724 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:34:50.251246 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:50.250894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:50.251246 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.251061 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:50.251246 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.251136 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret podName:3bacd02a-d64e-47c1-9a67-fe506b86dc0c nodeName:}" failed. No retries permitted until 2026-09-17 17:34:54.251116818 +0000 UTC m=+12.701002931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret") pod "global-pull-secret-syncer-ftr75" (UID: "3bacd02a-d64e-47c1-9a67-fe506b86dc0c") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:50.352263 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:50.352225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:50.352446 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:50.352301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:50.352446 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.352439 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:50.352603 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.352443 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:50.352603 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.352511 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:50.352603 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.352523 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs podName:9b7c7317-0809-4f38-8acb-709a2f66913f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:54.352504874 +0000 UTC m=+12.802390994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs") pod "network-metrics-daemon-6ntvh" (UID: "9b7c7317-0809-4f38-8acb-709a2f66913f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:50.352603 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.352523 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8g49t for pod openshift-network-diagnostics/network-check-target-5zfnp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:50.352603 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.352565 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t podName:3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f nodeName:}" failed. No retries permitted until 2026-09-17 17:34:54.352554317 +0000 UTC m=+12.802440428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8g49t" (UniqueName: "kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t") pod "network-check-target-5zfnp" (UID: "3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:50.748716 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:50.748657 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:50.748903 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.748808 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:34:50.748903 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:50.748864 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:50.749013 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:50.748935 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:34:51.751110 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:51.750402 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:51.751110 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:51.750542 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:34:52.748928 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:52.748417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:52.748928 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:52.748454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:52.748928 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:52.748587 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:34:52.748928 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:52.748730 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:34:53.749378 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:53.749343 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:53.749920 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:53.749505 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:34:54.286543 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:54.286506 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:54.286729 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.286665 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:54.286798 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.286740 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret podName:3bacd02a-d64e-47c1-9a67-fe506b86dc0c nodeName:}" failed. No retries permitted until 2026-09-17 17:35:02.286718896 +0000 UTC m=+20.736605007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret") pod "global-pull-secret-syncer-ftr75" (UID: "3bacd02a-d64e-47c1-9a67-fe506b86dc0c") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:54.387443 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:54.387405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:54.387647 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:54.387502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:54.387720 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.387682 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:54.387720 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.387703 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:54.387720 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.387716 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8g49t for pod openshift-network-diagnostics/network-check-target-5zfnp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:54.387864 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.387777 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t podName:3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f nodeName:}" failed. No retries permitted until 2026-09-17 17:35:02.387759388 +0000 UTC m=+20.837645501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8g49t" (UniqueName: "kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t") pod "network-check-target-5zfnp" (UID: "3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:54.388180 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.388160 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:54.388277 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.388216 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs podName:9b7c7317-0809-4f38-8acb-709a2f66913f nodeName:}" failed. No retries permitted until 2026-09-17 17:35:02.388201272 +0000 UTC m=+20.838087397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs") pod "network-metrics-daemon-6ntvh" (UID: "9b7c7317-0809-4f38-8acb-709a2f66913f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:54.748282 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:54.748247 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:54.748455 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.748393 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:34:54.748455 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:54.748247 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:54.748566 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:54.748507 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:34:55.749241 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:55.749207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:55.749707 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:55.749334 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:34:56.748922 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:56.748886 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:56.749159 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:56.748896 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:56.749159 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:56.748987 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:34:56.749159 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:56.749093 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:34:57.748491 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:57.748452 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:57.748950 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:57.748597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:34:58.748905 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:58.748865 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:34:58.748905 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:58.748889 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:34:58.749351 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:58.749017 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:34:58.749351 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:58.749107 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:34:59.749082 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:34:59.749041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:34:59.749494 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:34:59.749151 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:00.748705 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:00.748629 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:00.748939 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:00.748643 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:00.748939 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:00.748775 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:00.748939 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:00.748851 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:01.748739 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:01.748707 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:01.749192 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:01.748838 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:02.341676 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:02.341645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:02.341849 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.341808 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:35:02.341929 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.341871 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret podName:3bacd02a-d64e-47c1-9a67-fe506b86dc0c nodeName:}" failed. No retries permitted until 2026-09-17 17:35:18.341852818 +0000 UTC m=+36.791738935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret") pod "global-pull-secret-syncer-ftr75" (UID: "3bacd02a-d64e-47c1-9a67-fe506b86dc0c") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:35:02.442236 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:02.442199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:02.442396 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:02.442292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:02.442462 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.442411 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:35:02.442539 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.442410 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:35:02.442539 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.442522 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:35:02.442539 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.442535 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8g49t for pod openshift-network-diagnostics/network-check-target-5zfnp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:35:02.442685 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.442490 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs podName:9b7c7317-0809-4f38-8acb-709a2f66913f nodeName:}" failed. No retries permitted until 2026-09-17 17:35:18.442454844 +0000 UTC m=+36.892340952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs") pod "network-metrics-daemon-6ntvh" (UID: "9b7c7317-0809-4f38-8acb-709a2f66913f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:35:02.442685 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.442600 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t podName:3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f nodeName:}" failed. No retries permitted until 2026-09-17 17:35:18.44258253 +0000 UTC m=+36.892468644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8g49t" (UniqueName: "kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t") pod "network-check-target-5zfnp" (UID: "3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:35:02.749060 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:02.749030 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:02.749552 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.749133 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:02.749552 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:02.749197 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:02.749552 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:02.749322 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:03.749836 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:03.749802 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:03.750242 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:03.749885 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:04.749233 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.749053 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:04.749384 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.749097 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:04.749384 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:04.749311 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:04.749514 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:04.749405 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:04.890757 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.890500 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mbvzt" event={"ID":"34e63e2f-5e8b-410b-9df5-65e8686cd545","Type":"ContainerStarted","Data":"684bc41a0e1be91cfd2fbf8cd622329d1d1a40ef8e68113d586f0db127c18c24"} Sep 17 17:35:04.892131 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.892102 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5" containerID="c5516d62417febe6238291de6067f1aa60a09def7dfc078e42845d3acdb14ae5" exitCode=0 Sep 17 17:35:04.892220 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.892186 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" event={"ID":"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5","Type":"ContainerDied","Data":"c5516d62417febe6238291de6067f1aa60a09def7dfc078e42845d3acdb14ae5"} Sep 17 17:35:04.893645 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.893605 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fm4h" event={"ID":"62b695b7-eb68-45ac-8407-7f213aa2a087","Type":"ContainerStarted","Data":"c2d0bb83380879c6986b3049d0b98e385b5180cf7229618651e97b07586f8e48"} Sep 17 17:35:04.895104 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.895086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xsx7m" event={"ID":"ed4e9c2b-e3b2-41ee-8020-9058457dcf71","Type":"ContainerStarted","Data":"6e91f8f3785514ca1aacf4dee6a84c76c21d6b6f43865762bb1d0ad48cc0fd9d"} Sep 17 17:35:04.897195 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.897178 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:35:04.897559 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.897535 2562 generic.go:356] "Generic (PLEG): container finished" podID="08daf89f-358d-4053-85a7-7394070be216" containerID="858b618b60e1fd479adee1dd93c2c83d8428f1b57b290f8f0e4bfb25059c611b" exitCode=1 Sep 17 17:35:04.897611 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.897601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerStarted","Data":"097f22b4231dab40db28f68e7d23d7ec4471cd7fe6daa3116fd05db4f38fb647"} Sep 17 17:35:04.897670 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.897658 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerStarted","Data":"100ee91384b1a6433f9ea85ffc4a7b4a742cd5d6e9b504c89082322e1974788a"} Sep 17 17:35:04.897726 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.897696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerDied","Data":"858b618b60e1fd479adee1dd93c2c83d8428f1b57b290f8f0e4bfb25059c611b"} Sep 17 17:35:04.897774 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.897743 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerStarted","Data":"77a3c0f81724cf9d3e1ebe1060d7fc4db3f53fd19ac80d27c258853917635dfb"} Sep 17 17:35:04.899191 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.899166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hsm52" event={"ID":"bebbe153-c2af-43a2-8c8f-c93ce80ce9e2","Type":"ContainerStarted","Data":"d92a248cb4b74e7d7b3a886e813188bfa35e6269a426cb28b8a920be4c9da641"} Sep 17 17:35:04.900444 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.900426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-npk2q" event={"ID":"33b72a7d-7b44-46e7-af04-08d01670bb35","Type":"ContainerStarted","Data":"0a276f0c0d3cc70130dba3a497227e236ac75a6fd7798599e09ca637f490931b"} Sep 17 17:35:04.901692 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.901675 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" event={"ID":"d1d6a361-a950-4168-930c-94b5065fac6f","Type":"ContainerStarted","Data":"dccc421992ba306d984f8b5bb8797a68b5c93d809409a505404e6c638ac7e3e2"} Sep 17 17:35:04.913311 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.913266 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-116.ec2.internal" podStartSLOduration=18.91325417 podStartE2EDuration="18.91325417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:48.879197251 +0000 UTC m=+7.329083382" watchObservedRunningTime="2026-09-17 17:35:04.91325417 +0000 UTC m=+23.363140300" Sep 17 17:35:04.913595 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.913567 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mbvzt" podStartSLOduration=6.043731598 podStartE2EDuration="18.913558186s" totalImagesPullingTime="12.869826588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:04.911841285 +0000 UTC m=+23.361727415" watchObservedRunningTime="2026-09-17 17:35:04.913558186 +0000 UTC m=+23.363444316" Sep 17 17:35:04.938560 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.938510 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xsx7m" podStartSLOduration=3.556279061 podStartE2EDuration="20.938494455s" totalImagesPullingTime="17.382215394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:04.938371202 +0000 UTC m=+23.388257332" watchObservedRunningTime="2026-09-17 17:35:04.938494455 +0000 UTC m=+23.388380575" Sep 17 17:35:04.967660 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.967620 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hsm52" podStartSLOduration=3.616531956 podStartE2EDuration="20.967603774s" totalImagesPullingTime="17.351071818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:04.967268375 +0000 UTC m=+23.417154506" watchObservedRunningTime="2026-09-17 17:35:04.967603774 +0000 UTC m=+23.417489903" Sep 17 17:35:04.990629 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:04.990581 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6fm4h" podStartSLOduration=7.904928249 podStartE2EDuration="20.990559625s" totalImagesPullingTime="13.085631376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:04.990040588 +0000 UTC m=+23.439926719" watchObservedRunningTime="2026-09-17 17:35:04.990559625 +0000 UTC m=+23.440445780" Sep 17 17:35:05.023760 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.023713 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-npk2q" podStartSLOduration=7.914356719 podStartE2EDuration="21.023694548s" totalImagesPullingTime="13.109337829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:05.022959285 +0000 UTC m=+23.472845414" watchObservedRunningTime="2026-09-17 17:35:05.023694548 +0000 UTC m=+23.473580679" Sep 17 17:35:05.670749 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.670724 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 17:35:05.689171 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.689079 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:35:05.670745252Z","UUID":"c26d42b4-5d73-4172-ba7b-8fffce1ee685","Handler":null,"Name":"","Endpoint":""} Sep 17 17:35:05.691050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.691018 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 17:35:05.691050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.691052 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 17:35:05.748651 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.748619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:05.748810 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:05.748745 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:05.908253 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.908176 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:35:05.908659 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.908630 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerStarted","Data":"70a490eba2073f7bece7ad97e188e86ca7606db09415eac2daed0ca104b61fbc"} Sep 17 17:35:05.908727 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.908717 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerStarted","Data":"1f99c77f3adef539e96cad890402aaa44125ad9ecf44d5e02aff0711f75aa060"} Sep 17 17:35:05.911143 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.911112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" event={"ID":"d1d6a361-a950-4168-930c-94b5065fac6f","Type":"ContainerStarted","Data":"c40dd3454f3d7e7490eba51d489c7a32fa1273add40081f1619e4787dc2262f5"} Sep 17 17:35:05.912845 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:05.912811 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jwf54" event={"ID":"3579b563-b205-42d8-86f3-bfb21d947ace","Type":"ContainerStarted","Data":"646023a9de4f86228a2a7610fe47665f29e61d5836ea8d59586f1ac7dc062f48"} Sep 17 17:35:06.748358 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:06.748331 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:06.748562 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:06.748456 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:06.748562 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:06.748508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:06.748677 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:06.748644 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:06.824397 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:06.824348 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:35:06.825036 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:06.825010 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:35:06.849650 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:06.849596 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jwf54" podStartSLOduration=6.476039945 podStartE2EDuration="23.849571972s" totalImagesPullingTime="17.373532027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:05.936370345 +0000 UTC m=+24.386256474" watchObservedRunningTime="2026-09-17 17:35:06.849571972 +0000 UTC m=+25.299458105" Sep 17 17:35:06.918195 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:06.918111 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" event={"ID":"d1d6a361-a950-4168-930c-94b5065fac6f","Type":"ContainerStarted","Data":"0b4a39b8ed60877522b3729b5191949c216753962f87176b5761e7c581f1b6d7"} Sep 17 17:35:06.918649 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:06.918582 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:35:06.918884 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:06.918863 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-npk2q" Sep 17 17:35:06.973755 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:06.973699 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r9d7" podStartSLOduration=3.735844862 podStartE2EDuration="22.97367757s" totalImagesPullingTime="19.237832708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:06.947138566 +0000 UTC m=+25.397024697" watchObservedRunningTime="2026-09-17 17:35:06.97367757 +0000 UTC m=+25.423563701" Sep 17 17:35:07.748971 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:07.748777 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:07.749127 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:07.749081 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:07.924296 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:07.924266 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:35:07.924767 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:07.924737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerStarted","Data":"3d7b0f8da5ce6d57489d323fb24cf50a95eaceb4862c6c90055548a734770d4a"} Sep 17 17:35:08.749085 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:08.749058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:08.749295 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:08.749166 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:08.749295 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:08.749225 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:08.749388 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:08.749325 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:09.748621 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:09.748429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:09.749519 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:09.748702 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:09.931833 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:09.931716 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5" containerID="22328778dc32ccbc7afe171ff294d5e946bc0e427f130ebb72c3ca38d595a718" exitCode=0 Sep 17 17:35:09.931833 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:09.931792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" event={"ID":"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5","Type":"ContainerDied","Data":"22328778dc32ccbc7afe171ff294d5e946bc0e427f130ebb72c3ca38d595a718"} Sep 17 17:35:09.935528 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:09.935509 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:35:09.935882 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:09.935864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerStarted","Data":"5989c70b125b8c5365b0778ea9bdb78a12d0197c4206d719508213455a315057"} Sep 17 17:35:09.936116 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:09.936105 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:35:09.936291 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:09.936276 2562 scope.go:117] "RemoveContainer" containerID="858b618b60e1fd479adee1dd93c2c83d8428f1b57b290f8f0e4bfb25059c611b" Sep 17 17:35:09.952337 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:09.952315 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:35:10.748748 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:10.748705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:10.748748 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:10.748741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:10.749215 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:10.748858 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:10.749215 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:10.748990 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:10.942002 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:10.941974 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:35:10.942331 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:10.942311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" event={"ID":"08daf89f-358d-4053-85a7-7394070be216","Type":"ContainerStarted","Data":"00ff9ef53b6f8d26c748ecb6b9845f528223233e2dff693af6c9b384f45bd447"} Sep 17 17:35:10.942506 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:10.942467 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:35:10.942627 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:10.942535 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:35:10.957073 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:10.957041 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:35:10.985783 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:10.985742 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" podStartSLOduration=9.620858955 podStartE2EDuration="26.98572663s" totalImagesPullingTime="17.364867675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:10.985348382 +0000 UTC m=+29.435234513" watchObservedRunningTime="2026-09-17 17:35:10.98572663 +0000 UTC m=+29.435612759" Sep 17 17:35:11.657364 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:11.657190 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ftr75"] Sep 17 17:35:11.657558 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:11.657445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:11.657621 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:11.657574 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:11.667085 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:11.667018 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6ntvh"] Sep 17 17:35:11.667205 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:11.667117 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:11.667259 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:11.667219 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:11.669438 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:11.669416 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5zfnp"] Sep 17 17:35:11.669546 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:11.669514 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:11.669601 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:11.669581 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:11.946269 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:11.946189 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5" containerID="a55709a7ef65458af33272afa7366d738152d15704ec6c8e9c0a6a7b7d3d9d25" exitCode=0 Sep 17 17:35:11.946657 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:11.946274 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" event={"ID":"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5","Type":"ContainerDied","Data":"a55709a7ef65458af33272afa7366d738152d15704ec6c8e9c0a6a7b7d3d9d25"} Sep 17 17:35:12.748982 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:12.748946 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:12.749169 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:12.749075 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:13.749963 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:13.749932 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:13.750307 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:13.750047 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:13.750307 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:13.750098 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:13.750307 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:13.750195 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:13.953135 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:13.953053 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5" containerID="25d86274e8095309f8939189ddec5ad3459017a1b76766aaf133c7de5d4888dd" exitCode=0 Sep 17 17:35:13.953135 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:13.953116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" event={"ID":"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5","Type":"ContainerDied","Data":"25d86274e8095309f8939189ddec5ad3459017a1b76766aaf133c7de5d4888dd"} Sep 17 17:35:14.748769 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:14.748690 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:14.748900 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:14.748811 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:15.749197 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:15.749163 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:15.749835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:15.749164 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:15.749835 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:15.749282 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:15.749835 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:15.749391 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:16.749159 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:16.749121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:16.749323 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:16.749290 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:35:17.748919 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:17.748883 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:17.749119 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:17.749013 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zfnp" podUID="3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f" Sep 17 17:35:17.749119 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:17.749028 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:17.749119 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:17.749109 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ftr75" podUID="3bacd02a-d64e-47c1-9a67-fe506b86dc0c" Sep 17 17:35:18.364246 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.364219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:18.364759 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.364390 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:35:18.364759 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.364471 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret podName:3bacd02a-d64e-47c1-9a67-fe506b86dc0c nodeName:}" failed. No retries permitted until 2026-09-17 17:35:50.364450707 +0000 UTC m=+68.814336828 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret") pod "global-pull-secret-syncer-ftr75" (UID: "3bacd02a-d64e-47c1-9a67-fe506b86dc0c") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:35:18.395693 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.395660 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-116.ec2.internal" event="NodeReady" Sep 17 17:35:18.395833 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.395785 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 17:35:18.464769 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.464738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:18.464966 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.464802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:18.464966 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.464885 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:35:18.464966 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.464903 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:35:18.464966 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.464903 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:35:18.464966 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.464912 2562 projected.go:196] Error preparing data for projected volume kube-api-access-8g49t for pod openshift-network-diagnostics/network-check-target-5zfnp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:35:18.464966 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.464967 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs podName:9b7c7317-0809-4f38-8acb-709a2f66913f nodeName:}" failed. No retries permitted until 2026-09-17 17:35:50.46494912 +0000 UTC m=+68.914835241 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs") pod "network-metrics-daemon-6ntvh" (UID: "9b7c7317-0809-4f38-8acb-709a2f66913f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:35:18.465191 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.464989 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t podName:3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f nodeName:}" failed. No retries permitted until 2026-09-17 17:35:50.464977813 +0000 UTC m=+68.914863920 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8g49t" (UniqueName: "kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t") pod "network-check-target-5zfnp" (UID: "3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:35:18.502856 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.502815 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4fq65"] Sep 17 17:35:18.518734 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.518706 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4fq65" Sep 17 17:35:18.524435 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.524403 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 17:35:18.524596 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.524462 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 17:35:18.524596 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.524469 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 17:35:18.525051 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.524883 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mjhsr\"" Sep 17 17:35:18.534626 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.534604 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4fq65"] Sep 17 17:35:18.535252 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.535233 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x8l9j"] Sep 17 17:35:18.553166 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.553138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.557924 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.557902 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bqqq4\"" Sep 17 17:35:18.558049 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.558031 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 17:35:18.558575 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.558551 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 17:35:18.558951 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.558925 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x8l9j"] Sep 17 17:35:18.666320 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.666282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.666320 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.666320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/087b37b5-cb65-423a-b7f1-a95a764a45b4-config-volume\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.666576 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.666338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/087b37b5-cb65-423a-b7f1-a95a764a45b4-tmp-dir\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.666576 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.666358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq86q\" (UniqueName: \"kubernetes.io/projected/ee20a8ad-6e24-40dd-b3ba-c3fcf1639375-kube-api-access-wq86q\") pod \"ingress-canary-4fq65\" (UID: \"ee20a8ad-6e24-40dd-b3ba-c3fcf1639375\") " pod="openshift-ingress-canary/ingress-canary-4fq65" Sep 17 17:35:18.666576 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.666447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee20a8ad-6e24-40dd-b3ba-c3fcf1639375-cert\") pod \"ingress-canary-4fq65\" (UID: \"ee20a8ad-6e24-40dd-b3ba-c3fcf1639375\") " pod="openshift-ingress-canary/ingress-canary-4fq65" Sep 17 17:35:18.666576 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.666464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwvgn\" (UniqueName: \"kubernetes.io/projected/087b37b5-cb65-423a-b7f1-a95a764a45b4-kube-api-access-fwvgn\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.748964 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.748927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:18.752712 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.752688 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g24m8\"" Sep 17 17:35:18.752855 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.752688 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:35:18.767599 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.767576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq86q\" (UniqueName: \"kubernetes.io/projected/ee20a8ad-6e24-40dd-b3ba-c3fcf1639375-kube-api-access-wq86q\") pod \"ingress-canary-4fq65\" (UID: \"ee20a8ad-6e24-40dd-b3ba-c3fcf1639375\") " pod="openshift-ingress-canary/ingress-canary-4fq65" Sep 17 17:35:18.767683 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.767637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee20a8ad-6e24-40dd-b3ba-c3fcf1639375-cert\") pod \"ingress-canary-4fq65\" (UID: \"ee20a8ad-6e24-40dd-b3ba-c3fcf1639375\") " pod="openshift-ingress-canary/ingress-canary-4fq65" Sep 17 17:35:18.767683 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.767659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwvgn\" (UniqueName: \"kubernetes.io/projected/087b37b5-cb65-423a-b7f1-a95a764a45b4-kube-api-access-fwvgn\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.767750 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.767687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.767750 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.767713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/087b37b5-cb65-423a-b7f1-a95a764a45b4-config-volume\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.767810 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.767754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/087b37b5-cb65-423a-b7f1-a95a764a45b4-tmp-dir\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.767924 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.767910 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:18.767988 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:18.767977 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls podName:087b37b5-cb65-423a-b7f1-a95a764a45b4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:19.267952908 +0000 UTC m=+37.717839035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls") pod "dns-default-x8l9j" (UID: "087b37b5-cb65-423a-b7f1-a95a764a45b4") : secret "dns-default-metrics-tls" not found Sep 17 17:35:18.768055 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.768039 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/087b37b5-cb65-423a-b7f1-a95a764a45b4-tmp-dir\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.768342 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.768316 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/087b37b5-cb65-423a-b7f1-a95a764a45b4-config-volume\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.771680 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.771551 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee20a8ad-6e24-40dd-b3ba-c3fcf1639375-cert\") pod \"ingress-canary-4fq65\" (UID: \"ee20a8ad-6e24-40dd-b3ba-c3fcf1639375\") " pod="openshift-ingress-canary/ingress-canary-4fq65" Sep 17 17:35:18.784786 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.784761 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwvgn\" (UniqueName: \"kubernetes.io/projected/087b37b5-cb65-423a-b7f1-a95a764a45b4-kube-api-access-fwvgn\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:18.787515 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.787494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq86q\" (UniqueName: \"kubernetes.io/projected/ee20a8ad-6e24-40dd-b3ba-c3fcf1639375-kube-api-access-wq86q\") pod \"ingress-canary-4fq65\" (UID: \"ee20a8ad-6e24-40dd-b3ba-c3fcf1639375\") " pod="openshift-ingress-canary/ingress-canary-4fq65" Sep 17 17:35:18.827512 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.827440 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4fq65" Sep 17 17:35:18.967755 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.967727 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5" containerID="23202717ac46ae9c877177cbdfcecd535f26afefe4899b9dc82a672c869965a1" exitCode=0 Sep 17 17:35:18.967907 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:18.967779 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" event={"ID":"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5","Type":"ContainerDied","Data":"23202717ac46ae9c877177cbdfcecd535f26afefe4899b9dc82a672c869965a1"} Sep 17 17:35:19.160567 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.160535 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4fq65"] Sep 17 17:35:19.188260 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:35:19.188227 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee20a8ad_6e24_40dd_b3ba_c3fcf1639375.slice/crio-5fd5a69afaa7f2f2f8a6bfd61a06f05b5ef22f89e67f994cd6513597429d762f WatchSource:0}: Error finding container 5fd5a69afaa7f2f2f8a6bfd61a06f05b5ef22f89e67f994cd6513597429d762f: Status 404 returned error can't find the container with id 5fd5a69afaa7f2f2f8a6bfd61a06f05b5ef22f89e67f994cd6513597429d762f Sep 17 17:35:19.272292 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.272252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:19.272462 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:19.272399 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:19.272533 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:19.272472 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls podName:087b37b5-cb65-423a-b7f1-a95a764a45b4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:20.272456517 +0000 UTC m=+38.722342625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls") pod "dns-default-x8l9j" (UID: "087b37b5-cb65-423a-b7f1-a95a764a45b4") : secret "dns-default-metrics-tls" not found Sep 17 17:35:19.748310 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.748276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:19.748886 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.748276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:19.751390 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.751367 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2vz4h\"" Sep 17 17:35:19.751976 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.751806 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:35:19.751976 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.751941 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:35:19.752121 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.752053 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:35:19.972357 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.972318 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4fq65" event={"ID":"ee20a8ad-6e24-40dd-b3ba-c3fcf1639375","Type":"ContainerStarted","Data":"5fd5a69afaa7f2f2f8a6bfd61a06f05b5ef22f89e67f994cd6513597429d762f"} Sep 17 17:35:19.976140 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.976104 2562 generic.go:356] "Generic (PLEG): container finished" podID="8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5" containerID="0cd31c6190c469d2bab8847358c757308cc7ad3be4ec9d13af286d9a9496f9ea" exitCode=0 Sep 17 17:35:19.976270 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:19.976161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" event={"ID":"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5","Type":"ContainerDied","Data":"0cd31c6190c469d2bab8847358c757308cc7ad3be4ec9d13af286d9a9496f9ea"} Sep 17 17:35:20.281304 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:20.281221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:20.281514 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:20.281360 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:20.281514 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:20.281422 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls podName:087b37b5-cb65-423a-b7f1-a95a764a45b4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:22.281403598 +0000 UTC m=+40.731289708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls") pod "dns-default-x8l9j" (UID: "087b37b5-cb65-423a-b7f1-a95a764a45b4") : secret "dns-default-metrics-tls" not found Sep 17 17:35:20.984468 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:20.984392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" event={"ID":"8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5","Type":"ContainerStarted","Data":"4120f5f8c7d2eaab9edb5186b75afa1b97aa484d2bfcc481d9b015cfae9f9b6e"} Sep 17 17:35:21.018495 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:21.018433 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2mx2t" podStartSLOduration=8.999455934 podStartE2EDuration="37.018412207s" totalImagesPullingTime="28.018956273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:21.018358716 +0000 UTC m=+39.468244848" watchObservedRunningTime="2026-09-17 17:35:21.018412207 +0000 UTC m=+39.468298337" Sep 17 17:35:21.988495 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:21.988437 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4fq65" event={"ID":"ee20a8ad-6e24-40dd-b3ba-c3fcf1639375","Type":"ContainerStarted","Data":"b35d4064f8a73cb23f34e3e09b2fc5dacc90caf53ebf9462c20f62c4254b7124"} Sep 17 17:35:22.013250 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:22.013202 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4fq65" podStartSLOduration=1.5469239479999999 podStartE2EDuration="4.013188381s" totalImagesPullingTime="2.466264433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:22.012966848 +0000 UTC m=+40.462852983" watchObservedRunningTime="2026-09-17 17:35:22.013188381 +0000 UTC m=+40.463074519" Sep 17 17:35:22.296964 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:22.296873 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:22.297115 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:22.296982 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:22.297115 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:22.297035 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls podName:087b37b5-cb65-423a-b7f1-a95a764a45b4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:26.297021637 +0000 UTC m=+44.746907744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls") pod "dns-default-x8l9j" (UID: "087b37b5-cb65-423a-b7f1-a95a764a45b4") : secret "dns-default-metrics-tls" not found Sep 17 17:35:26.320631 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:26.320585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:26.321120 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:26.320699 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:26.321120 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:26.320749 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls podName:087b37b5-cb65-423a-b7f1-a95a764a45b4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:34.320736629 +0000 UTC m=+52.770622738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls") pod "dns-default-x8l9j" (UID: "087b37b5-cb65-423a-b7f1-a95a764a45b4") : secret "dns-default-metrics-tls" not found Sep 17 17:35:34.379619 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:34.379571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:34.380004 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:34.379717 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:34.380004 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:34.379795 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls podName:087b37b5-cb65-423a-b7f1-a95a764a45b4 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:50.379776461 +0000 UTC m=+68.829662569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls") pod "dns-default-x8l9j" (UID: "087b37b5-cb65-423a-b7f1-a95a764a45b4") : secret "dns-default-metrics-tls" not found Sep 17 17:35:42.965605 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:42.965576 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hxld" Sep 17 17:35:50.372889 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.372852 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:50.375593 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.375575 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:35:50.387592 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.387559 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bacd02a-d64e-47c1-9a67-fe506b86dc0c-original-pull-secret\") pod \"global-pull-secret-syncer-ftr75\" (UID: \"3bacd02a-d64e-47c1-9a67-fe506b86dc0c\") " pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:50.473962 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.473922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:35:50.473962 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.473960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:35:50.474160 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.473991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:50.474160 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:50.474096 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:50.474239 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:50.474228 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls podName:087b37b5-cb65-423a-b7f1-a95a764a45b4 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:22.474213218 +0000 UTC m=+100.924099332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls") pod "dns-default-x8l9j" (UID: "087b37b5-cb65-423a-b7f1-a95a764a45b4") : secret "dns-default-metrics-tls" not found Sep 17 17:35:50.477028 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.477007 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:35:50.477075 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.477013 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:35:50.484545 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:50.484520 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 17:35:50.484609 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:35:50.484599 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs podName:9b7c7317-0809-4f38-8acb-709a2f66913f nodeName:}" failed. No retries permitted until 2026-09-17 17:36:54.484580917 +0000 UTC m=+132.934467026 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs") pod "network-metrics-daemon-6ntvh" (UID: "9b7c7317-0809-4f38-8acb-709a2f66913f") : secret "metrics-daemon-secret" not found Sep 17 17:35:50.486883 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.486866 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:35:50.497026 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.496994 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g49t\" (UniqueName: \"kubernetes.io/projected/3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f-kube-api-access-8g49t\") pod \"network-check-target-5zfnp\" (UID: \"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f\") " pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:50.664960 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.664881 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2vz4h\"" Sep 17 17:35:50.665099 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.665075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ftr75" Sep 17 17:35:50.671731 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.671712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:50.947908 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.947802 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ftr75"] Sep 17 17:35:50.951360 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:35:50.951337 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bacd02a_d64e_47c1_9a67_fe506b86dc0c.slice/crio-a0749bd9c30a6ca6c8855661e8cedff116107171ac63f616c8b64c1a2d855c3c WatchSource:0}: Error finding container a0749bd9c30a6ca6c8855661e8cedff116107171ac63f616c8b64c1a2d855c3c: Status 404 returned error can't find the container with id a0749bd9c30a6ca6c8855661e8cedff116107171ac63f616c8b64c1a2d855c3c Sep 17 17:35:50.953806 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:50.953787 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5zfnp"] Sep 17 17:35:50.956728 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:35:50.956706 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc0303e_5ff1_4167_9ccb_1b8c078c5d6f.slice/crio-d71ad20c328a629b1df3606d10a10e3ed9c461832988b78c2e8262cd618d6672 WatchSource:0}: Error finding container d71ad20c328a629b1df3606d10a10e3ed9c461832988b78c2e8262cd618d6672: Status 404 returned error can't find the container with id d71ad20c328a629b1df3606d10a10e3ed9c461832988b78c2e8262cd618d6672 Sep 17 17:35:51.060540 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:51.060501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5zfnp" event={"ID":"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f","Type":"ContainerStarted","Data":"d71ad20c328a629b1df3606d10a10e3ed9c461832988b78c2e8262cd618d6672"} Sep 17 17:35:51.061584 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:51.061562 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ftr75" event={"ID":"3bacd02a-d64e-47c1-9a67-fe506b86dc0c","Type":"ContainerStarted","Data":"a0749bd9c30a6ca6c8855661e8cedff116107171ac63f616c8b64c1a2d855c3c"} Sep 17 17:35:56.076749 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:56.076711 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5zfnp" event={"ID":"3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f","Type":"ContainerStarted","Data":"707ffde813d79753d5547d36f9e60cf61b583bc3d45ed364d249512e8fb5e07b"} Sep 17 17:35:56.077260 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:56.076817 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:35:56.078199 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:56.078173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ftr75" event={"ID":"3bacd02a-d64e-47c1-9a67-fe506b86dc0c","Type":"ContainerStarted","Data":"f3c6059b237992c62a0874510ce1b9e1c6e06587ad37b9723c1bfa65df5398d7"} Sep 17 17:35:56.107509 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:35:56.107444 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5zfnp" podStartSLOduration=68.867012312 podStartE2EDuration="1m13.107430032s" totalImagesPullingTime="4.24041772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:56.107276486 +0000 UTC m=+74.557162617" watchObservedRunningTime="2026-09-17 17:35:56.107430032 +0000 UTC m=+74.557316152" Sep 17 17:36:22.493493 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:22.493438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:36:22.493864 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:22.493590 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:36:22.493864 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:22.493658 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls podName:087b37b5-cb65-423a-b7f1-a95a764a45b4 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:26.493640382 +0000 UTC m=+164.943526495 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls") pod "dns-default-x8l9j" (UID: "087b37b5-cb65-423a-b7f1-a95a764a45b4") : secret "dns-default-metrics-tls" not found Sep 17 17:36:27.083700 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:27.083669 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5zfnp" Sep 17 17:36:27.110998 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:27.110948 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ftr75" podStartSLOduration=98.861128058 podStartE2EDuration="1m43.110933973s" totalImagesPullingTime="4.249805915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:56.131116296 +0000 UTC m=+74.581002426" watchObservedRunningTime="2026-09-17 17:36:27.110933973 +0000 UTC m=+105.560820143" Sep 17 17:36:54.505605 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:54.505563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:36:54.506101 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:54.505706 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 17:36:54.506101 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:54.505768 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs podName:9b7c7317-0809-4f38-8acb-709a2f66913f nodeName:}" failed. No retries permitted until 2026-09-17 17:38:56.505753666 +0000 UTC m=+254.955639775 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs") pod "network-metrics-daemon-6ntvh" (UID: "9b7c7317-0809-4f38-8acb-709a2f66913f") : secret "metrics-daemon-secret" not found Sep 17 17:36:55.863715 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.863679 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr"] Sep 17 17:36:55.865205 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.865190 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:55.868594 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.868559 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 17 17:36:55.868594 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.868579 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:36:55.868768 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.868618 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 17 17:36:55.868882 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.868870 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 17 17:36:55.869584 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.869560 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cbvpr\"" Sep 17 17:36:55.883343 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.883317 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr"] Sep 17 17:36:55.988133 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.988101 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl"] Sep 17 17:36:55.989920 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.989905 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl" Sep 17 17:36:55.993813 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.993791 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:36:55.993947 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.993823 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zc4m7\"" Sep 17 17:36:55.994001 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:55.993949 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 17:36:56.001771 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.001749 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl"] Sep 17 17:36:56.015292 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.015272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/956d69c2-e84d-4f8f-be9e-4f0ceadc534e-config\") pod \"service-ca-operator-57cdc4b768-ccfxr\" (UID: \"956d69c2-e84d-4f8f-be9e-4f0ceadc534e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.015425 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.015307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/956d69c2-e84d-4f8f-be9e-4f0ceadc534e-serving-cert\") pod \"service-ca-operator-57cdc4b768-ccfxr\" (UID: \"956d69c2-e84d-4f8f-be9e-4f0ceadc534e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.015425 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.015364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgsmz\" (UniqueName: \"kubernetes.io/projected/956d69c2-e84d-4f8f-be9e-4f0ceadc534e-kube-api-access-xgsmz\") pod \"service-ca-operator-57cdc4b768-ccfxr\" (UID: \"956d69c2-e84d-4f8f-be9e-4f0ceadc534e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.016201 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.016182 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-dtl88"] Sep 17 17:36:56.017876 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.017861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.021292 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.021276 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 17:36:56.021757 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.021741 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 17 17:36:56.021809 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.021774 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gw4pg\"" Sep 17 17:36:56.021854 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.021829 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 17:36:56.022561 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.022545 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 17 17:36:56.029237 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.029218 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 17 17:36:56.035493 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.035461 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-dtl88"] Sep 17 17:36:56.075917 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.075890 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2"] Sep 17 17:36:56.077410 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.077394 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.081556 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.081530 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 17:36:56.081556 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.081547 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 17:36:56.081715 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.081549 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 17:36:56.081948 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.081929 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 17:36:56.082004 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.081989 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nkg2m\"" Sep 17 17:36:56.085655 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.085636 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8479cf6c55-gkp67"] Sep 17 17:36:56.087082 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.087066 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85d7c9949b-98b2q"] Sep 17 17:36:56.087188 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.087172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.088635 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.088618 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.093565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.092184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 17:36:56.093565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.092248 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 17:36:56.093565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.092260 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6xvsk\"" Sep 17 17:36:56.093565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.092713 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 17 17:36:56.093565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.092738 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 17:36:56.093565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.092954 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 17 17:36:56.093565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.093161 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 17 17:36:56.093565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.093254 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 17 17:36:56.093565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.093335 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 17:36:56.094224 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.093591 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 17:36:56.094360 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.094322 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-srhmt\"" Sep 17 17:36:56.098420 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.098402 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2"] Sep 17 17:36:56.104545 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.104528 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 17:36:56.107243 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.107222 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d7c9949b-98b2q"] Sep 17 17:36:56.115404 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115356 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8479cf6c55-gkp67"] Sep 17 17:36:56.115684 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgsmz\" (UniqueName: \"kubernetes.io/projected/956d69c2-e84d-4f8f-be9e-4f0ceadc534e-kube-api-access-xgsmz\") pod \"service-ca-operator-57cdc4b768-ccfxr\" (UID: \"956d69c2-e84d-4f8f-be9e-4f0ceadc534e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.115769 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b702e320-39d6-43cd-aecb-3fdac70f15fb-snapshots\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.115769 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b702e320-39d6-43cd-aecb-3fdac70f15fb-tmp\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.115881 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b702e320-39d6-43cd-aecb-3fdac70f15fb-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.115881 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/956d69c2-e84d-4f8f-be9e-4f0ceadc534e-config\") pod \"service-ca-operator-57cdc4b768-ccfxr\" (UID: \"956d69c2-e84d-4f8f-be9e-4f0ceadc534e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.115980 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df54w\" (UniqueName: \"kubernetes.io/projected/fb7d3a49-3f14-4035-9ef4-0425b7ebbcae-kube-api-access-df54w\") pod \"volume-data-source-validator-5c4db8bdf9-2szcl\" (UID: \"fb7d3a49-3f14-4035-9ef4-0425b7ebbcae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl" Sep 17 17:36:56.115980 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48n6n\" (UniqueName: \"kubernetes.io/projected/b702e320-39d6-43cd-aecb-3fdac70f15fb-kube-api-access-48n6n\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.115980 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b702e320-39d6-43cd-aecb-3fdac70f15fb-serving-cert\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.115980 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/956d69c2-e84d-4f8f-be9e-4f0ceadc534e-serving-cert\") pod \"service-ca-operator-57cdc4b768-ccfxr\" (UID: \"956d69c2-e84d-4f8f-be9e-4f0ceadc534e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.116125 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.115986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b702e320-39d6-43cd-aecb-3fdac70f15fb-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.116355 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.116339 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/956d69c2-e84d-4f8f-be9e-4f0ceadc534e-config\") pod \"service-ca-operator-57cdc4b768-ccfxr\" (UID: \"956d69c2-e84d-4f8f-be9e-4f0ceadc534e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.118207 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.118188 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/956d69c2-e84d-4f8f-be9e-4f0ceadc534e-serving-cert\") pod \"service-ca-operator-57cdc4b768-ccfxr\" (UID: \"956d69c2-e84d-4f8f-be9e-4f0ceadc534e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.131196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.131177 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgsmz\" (UniqueName: \"kubernetes.io/projected/956d69c2-e84d-4f8f-be9e-4f0ceadc534e-kube-api-access-xgsmz\") pod \"service-ca-operator-57cdc4b768-ccfxr\" (UID: \"956d69c2-e84d-4f8f-be9e-4f0ceadc534e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.173981 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.173955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.216980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-installation-pull-secrets\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217045 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b702e320-39d6-43cd-aecb-3fdac70f15fb-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-default-certificate\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-stats-auth\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217147 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2qcv\" (UniqueName: \"kubernetes.io/projected/e26f0b1b-8147-48a3-b742-07341db1c109-kube-api-access-x2qcv\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqbg2\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-kube-api-access-nqbg2\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217212 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b702e320-39d6-43cd-aecb-3fdac70f15fb-tmp\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b702e320-39d6-43cd-aecb-3fdac70f15fb-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8j7t\" (UniqueName: \"kubernetes.io/projected/939c3109-7819-4fe8-8dd9-187fa766aca7-kube-api-access-f8j7t\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b702e320-39d6-43cd-aecb-3fdac70f15fb-serving-cert\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217348 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-image-registry-private-configuration\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217395 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-ca-trust-extracted\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-certificates\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.217899 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b702e320-39d6-43cd-aecb-3fdac70f15fb-snapshots\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.218688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/939c3109-7819-4fe8-8dd9-187fa766aca7-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.218688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.218688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217570 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48n6n\" (UniqueName: \"kubernetes.io/projected/b702e320-39d6-43cd-aecb-3fdac70f15fb-kube-api-access-48n6n\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.218688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.218688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-bound-sa-token\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.218688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df54w\" (UniqueName: \"kubernetes.io/projected/fb7d3a49-3f14-4035-9ef4-0425b7ebbcae-kube-api-access-df54w\") pod \"volume-data-source-validator-5c4db8bdf9-2szcl\" (UID: \"fb7d3a49-3f14-4035-9ef4-0425b7ebbcae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl" Sep 17 17:36:56.218688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-trusted-ca\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.218688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.217711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.218688 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.218589 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b702e320-39d6-43cd-aecb-3fdac70f15fb-tmp\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.219148 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.219125 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b702e320-39d6-43cd-aecb-3fdac70f15fb-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.219203 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.219140 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b702e320-39d6-43cd-aecb-3fdac70f15fb-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.220619 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.220446 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b702e320-39d6-43cd-aecb-3fdac70f15fb-snapshots\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.222016 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.221771 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b702e320-39d6-43cd-aecb-3fdac70f15fb-serving-cert\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.239365 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.239336 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48n6n\" (UniqueName: \"kubernetes.io/projected/b702e320-39d6-43cd-aecb-3fdac70f15fb-kube-api-access-48n6n\") pod \"insights-operator-6f9c644dd9-dtl88\" (UID: \"b702e320-39d6-43cd-aecb-3fdac70f15fb\") " pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.239491 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.239376 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df54w\" (UniqueName: \"kubernetes.io/projected/fb7d3a49-3f14-4035-9ef4-0425b7ebbcae-kube-api-access-df54w\") pod \"volume-data-source-validator-5c4db8bdf9-2szcl\" (UID: \"fb7d3a49-3f14-4035-9ef4-0425b7ebbcae\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl" Sep 17 17:36:56.298501 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.298441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl" Sep 17 17:36:56.318035 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-image-registry-private-configuration\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.318155 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.318155 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-ca-trust-extracted\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.318155 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-certificates\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.318155 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/939c3109-7819-4fe8-8dd9-187fa766aca7-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.318155 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.318178 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.318195 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479cf6c55-gkp67: secret "image-registry-tls" not found Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-bound-sa-token\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.318253 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls podName:74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c nodeName:}" failed. No retries permitted until 2026-09-17 17:36:56.818234017 +0000 UTC m=+135.268120148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls") pod "image-registry-8479cf6c55-gkp67" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c") : secret "image-registry-tls" not found Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-trusted-ca\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.318304 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.318351 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls podName:939c3109-7819-4fe8-8dd9-187fa766aca7 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:56.818339687 +0000 UTC m=+135.268225809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-snhg2" (UID: "939c3109-7819-4fe8-8dd9-187fa766aca7") : secret "cluster-monitoring-operator-tls" not found Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.318371 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:56.818360593 +0000 UTC m=+135.268246703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : configmap references non-existent config key: service-ca.crt Sep 17 17:36:56.318410 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-installation-pull-secrets\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.319003 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.318412 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:36:56.319003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-default-certificate\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.319003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318443 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-ca-trust-extracted\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.319003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-stats-auth\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.319003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2qcv\" (UniqueName: \"kubernetes.io/projected/e26f0b1b-8147-48a3-b742-07341db1c109-kube-api-access-x2qcv\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.319003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqbg2\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-kube-api-access-nqbg2\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.319003 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.318621 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:56.818602127 +0000 UTC m=+135.268488235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : secret "router-metrics-certs-default" not found Sep 17 17:36:56.319003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318916 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-certificates\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.319003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.318985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8j7t\" (UniqueName: \"kubernetes.io/projected/939c3109-7819-4fe8-8dd9-187fa766aca7-kube-api-access-f8j7t\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.319519 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.319305 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/939c3109-7819-4fe8-8dd9-187fa766aca7-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.320183 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.320155 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-trusted-ca\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.320859 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.320835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-image-registry-private-configuration\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.321310 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.321286 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-default-certificate\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.321418 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.321402 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-stats-auth\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.321784 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.321767 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-installation-pull-secrets\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.326636 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.326610 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" Sep 17 17:36:56.327587 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.327564 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-bound-sa-token\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.328919 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.328891 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8j7t\" (UniqueName: \"kubernetes.io/projected/939c3109-7819-4fe8-8dd9-187fa766aca7-kube-api-access-f8j7t\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.329142 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.329112 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2qcv\" (UniqueName: \"kubernetes.io/projected/e26f0b1b-8147-48a3-b742-07341db1c109-kube-api-access-x2qcv\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.330164 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.330147 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqbg2\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-kube-api-access-nqbg2\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.444240 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.444206 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr"] Sep 17 17:36:56.448183 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:36:56.448153 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956d69c2_e84d_4f8f_be9e_4f0ceadc534e.slice/crio-4bd8a755c67bf27786703129c924566c7257bde32cfff4729c7834ce721fb981 WatchSource:0}: Error finding container 4bd8a755c67bf27786703129c924566c7257bde32cfff4729c7834ce721fb981: Status 404 returned error can't find the container with id 4bd8a755c67bf27786703129c924566c7257bde32cfff4729c7834ce721fb981 Sep 17 17:36:56.566910 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.566878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl"] Sep 17 17:36:56.569642 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:36:56.569617 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb7d3a49_3f14_4035_9ef4_0425b7ebbcae.slice/crio-59c66e9f2b16c0099e66b6d11027888410be0c1d4d36181712bcf48322dfe71f WatchSource:0}: Error finding container 59c66e9f2b16c0099e66b6d11027888410be0c1d4d36181712bcf48322dfe71f: Status 404 returned error can't find the container with id 59c66e9f2b16c0099e66b6d11027888410be0c1d4d36181712bcf48322dfe71f Sep 17 17:36:56.603157 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.603134 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-dtl88"] Sep 17 17:36:56.603599 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:36:56.603577 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb702e320_39d6_43cd_aecb_3fdac70f15fb.slice/crio-341173cc04d5afa0f37844bc620576aef42d57c5f7745fe3f01f55e7f21b3a91 WatchSource:0}: Error finding container 341173cc04d5afa0f37844bc620576aef42d57c5f7745fe3f01f55e7f21b3a91: Status 404 returned error can't find the container with id 341173cc04d5afa0f37844bc620576aef42d57c5f7745fe3f01f55e7f21b3a91 Sep 17 17:36:56.824054 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.824018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:56.824054 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.824057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.824254 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.824085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:56.824254 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:56.824121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:56.824254 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.824158 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:36:56.824254 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.824174 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:36:56.824254 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.824233 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:57.82421312 +0000 UTC m=+136.274099255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : configmap references non-existent config key: service-ca.crt Sep 17 17:36:56.824254 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.824236 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 17:36:56.824254 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.824253 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:57.824243664 +0000 UTC m=+136.274129775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : secret "router-metrics-certs-default" not found Sep 17 17:36:56.824493 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.824178 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479cf6c55-gkp67: secret "image-registry-tls" not found Sep 17 17:36:56.824493 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.824278 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls podName:939c3109-7819-4fe8-8dd9-187fa766aca7 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:57.824267505 +0000 UTC m=+136.274153630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-snhg2" (UID: "939c3109-7819-4fe8-8dd9-187fa766aca7") : secret "cluster-monitoring-operator-tls" not found Sep 17 17:36:56.824493 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:56.824304 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls podName:74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c nodeName:}" failed. No retries permitted until 2026-09-17 17:36:57.824290444 +0000 UTC m=+136.274176556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls") pod "image-registry-8479cf6c55-gkp67" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c") : secret "image-registry-tls" not found Sep 17 17:36:57.226370 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:57.226236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" event={"ID":"b702e320-39d6-43cd-aecb-3fdac70f15fb","Type":"ContainerStarted","Data":"341173cc04d5afa0f37844bc620576aef42d57c5f7745fe3f01f55e7f21b3a91"} Sep 17 17:36:57.228036 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:57.228011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl" event={"ID":"fb7d3a49-3f14-4035-9ef4-0425b7ebbcae","Type":"ContainerStarted","Data":"59c66e9f2b16c0099e66b6d11027888410be0c1d4d36181712bcf48322dfe71f"} Sep 17 17:36:57.229666 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:57.229623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" event={"ID":"956d69c2-e84d-4f8f-be9e-4f0ceadc534e","Type":"ContainerStarted","Data":"4bd8a755c67bf27786703129c924566c7257bde32cfff4729c7834ce721fb981"} Sep 17 17:36:57.833213 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:57.833178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:57.833392 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:57.833230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:57.833392 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:57.833269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:57.833392 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:57.833302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:57.833392 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:57.833372 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:36:57.833392 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:57.833388 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:36:57.833644 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:57.833395 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479cf6c55-gkp67: secret "image-registry-tls" not found Sep 17 17:36:57.833644 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:57.833406 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 17:36:57.833644 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:57.833434 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:59.833417614 +0000 UTC m=+138.283303736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : secret "router-metrics-certs-default" not found Sep 17 17:36:57.833644 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:57.833449 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:59.833441631 +0000 UTC m=+138.283327739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : configmap references non-existent config key: service-ca.crt Sep 17 17:36:57.833644 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:57.833464 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls podName:74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c nodeName:}" failed. No retries permitted until 2026-09-17 17:36:59.833456588 +0000 UTC m=+138.283342702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls") pod "image-registry-8479cf6c55-gkp67" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c") : secret "image-registry-tls" not found Sep 17 17:36:57.833644 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:57.833497 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls podName:939c3109-7819-4fe8-8dd9-187fa766aca7 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:59.833470608 +0000 UTC m=+138.283356715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-snhg2" (UID: "939c3109-7819-4fe8-8dd9-187fa766aca7") : secret "cluster-monitoring-operator-tls" not found Sep 17 17:36:58.234683 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:58.234643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl" event={"ID":"fb7d3a49-3f14-4035-9ef4-0425b7ebbcae","Type":"ContainerStarted","Data":"82fcc0b54eb763ada478d732a1b73196b27558e868813e178746b0f9b786ff89"} Sep 17 17:36:58.256063 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:58.255988 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-2szcl" podStartSLOduration=2.141567721 podStartE2EDuration="3.255967017s" totalImagesPullingTime="1.114399296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:58.255109936 +0000 UTC m=+136.704996070" watchObservedRunningTime="2026-09-17 17:36:58.255967017 +0000 UTC m=+136.705853154" Sep 17 17:36:59.238769 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.238736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" event={"ID":"956d69c2-e84d-4f8f-be9e-4f0ceadc534e","Type":"ContainerStarted","Data":"68a571bb41ecd3032a0973923ebab683d1662e00cfb8805eb816fa0563cd84d1"} Sep 17 17:36:59.269359 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.269248 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" podStartSLOduration=2.136581228 podStartE2EDuration="4.269230112s" totalImagesPullingTime="2.132648884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:59.268265625 +0000 UTC m=+137.718151754" watchObservedRunningTime="2026-09-17 17:36:59.269230112 +0000 UTC m=+137.719116241" Sep 17 17:36:59.849159 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.849122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:36:59.849444 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.849185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:59.849444 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.849277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:36:59.849444 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.849310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:36:59.849444 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:59.849278 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 17:36:59.849444 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:59.849337 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:03.849314266 +0000 UTC m=+142.299200387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : configmap references non-existent config key: service-ca.crt Sep 17 17:36:59.849444 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:59.849353 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:36:59.849444 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:59.849368 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479cf6c55-gkp67: secret "image-registry-tls" not found Sep 17 17:36:59.849444 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:59.849372 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls podName:939c3109-7819-4fe8-8dd9-187fa766aca7 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:03.849363162 +0000 UTC m=+142.299249276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-snhg2" (UID: "939c3109-7819-4fe8-8dd9-187fa766aca7") : secret "cluster-monitoring-operator-tls" not found Sep 17 17:36:59.849444 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:59.849405 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls podName:74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c nodeName:}" failed. No retries permitted until 2026-09-17 17:37:03.849390866 +0000 UTC m=+142.299277014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls") pod "image-registry-8479cf6c55-gkp67" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c") : secret "image-registry-tls" not found Sep 17 17:36:59.849798 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:59.849467 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:36:59.849798 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:36:59.849528 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:03.849517799 +0000 UTC m=+142.299403906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : secret "router-metrics-certs-default" not found Sep 17 17:36:59.940068 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.940033 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q"] Sep 17 17:36:59.942149 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.942132 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q" Sep 17 17:36:59.944874 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.944851 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 17 17:36:59.944997 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.944851 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 17 17:36:59.945777 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.945758 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jwp2p\"" Sep 17 17:36:59.953903 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:36:59.953879 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q"] Sep 17 17:37:00.050298 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.050259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbzvf\" (UniqueName: \"kubernetes.io/projected/52ea0606-0389-4f4d-8da2-c91a2c882a80-kube-api-access-nbzvf\") pod \"migrator-76794cbd6c-nnb5q\" (UID: \"52ea0606-0389-4f4d-8da2-c91a2c882a80\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q" Sep 17 17:37:00.150963 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.150879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbzvf\" (UniqueName: \"kubernetes.io/projected/52ea0606-0389-4f4d-8da2-c91a2c882a80-kube-api-access-nbzvf\") pod \"migrator-76794cbd6c-nnb5q\" (UID: \"52ea0606-0389-4f4d-8da2-c91a2c882a80\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q" Sep 17 17:37:00.160173 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.160142 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbzvf\" (UniqueName: \"kubernetes.io/projected/52ea0606-0389-4f4d-8da2-c91a2c882a80-kube-api-access-nbzvf\") pod \"migrator-76794cbd6c-nnb5q\" (UID: \"52ea0606-0389-4f4d-8da2-c91a2c882a80\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q" Sep 17 17:37:00.243654 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.243621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" event={"ID":"b702e320-39d6-43cd-aecb-3fdac70f15fb","Type":"ContainerStarted","Data":"ead4261bcc8a71e4f7d6173a5666a90b4fef8bf6b98bde2eccae5ed90ab43174"} Sep 17 17:37:00.252153 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.252134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q" Sep 17 17:37:00.267002 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.266949 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" podStartSLOduration=2.640434659 podStartE2EDuration="5.266928469s" totalImagesPullingTime="2.62649381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:00.264292919 +0000 UTC m=+138.714179051" watchObservedRunningTime="2026-09-17 17:37:00.266928469 +0000 UTC m=+138.716814600" Sep 17 17:37:00.524847 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.524817 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q"] Sep 17 17:37:00.526667 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:00.526628 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ea0606_0389_4f4d_8da2_c91a2c882a80.slice/crio-5df615793824b28c9f3c5e12188d4902dd27bbd8e7b25c3b9ce1d5d38f09ab95 WatchSource:0}: Error finding container 5df615793824b28c9f3c5e12188d4902dd27bbd8e7b25c3b9ce1d5d38f09ab95: Status 404 returned error can't find the container with id 5df615793824b28c9f3c5e12188d4902dd27bbd8e7b25c3b9ce1d5d38f09ab95 Sep 17 17:37:00.955658 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.955582 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l5lqq"] Sep 17 17:37:00.958246 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.958223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:00.961023 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.961001 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 17:37:00.961023 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.961017 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d9vw5\"" Sep 17 17:37:00.961462 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.961442 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 17:37:00.970313 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:00.970290 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l5lqq"] Sep 17 17:37:01.059706 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.059671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.059871 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.059727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd228\" (UniqueName: \"kubernetes.io/projected/b1d454c2-4885-4017-9132-7680f40cc963-kube-api-access-wd228\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.059871 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.059749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1d454c2-4885-4017-9132-7680f40cc963-data-volume\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.059871 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.059815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.059977 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.059875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1d454c2-4885-4017-9132-7680f40cc963-crio-socket\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.161299 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.161261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd228\" (UniqueName: \"kubernetes.io/projected/b1d454c2-4885-4017-9132-7680f40cc963-kube-api-access-wd228\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.161299 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.161302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1d454c2-4885-4017-9132-7680f40cc963-data-volume\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.161638 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.161374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.161638 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.161416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1d454c2-4885-4017-9132-7680f40cc963-crio-socket\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.161638 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.161462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.161638 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:01.161557 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:37:01.161638 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:01.161575 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:37:01.161638 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:01.161630 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:01.66161164 +0000 UTC m=+140.111497768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : configmap "kube-rbac-proxy" not found Sep 17 17:37:01.161638 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.161562 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1d454c2-4885-4017-9132-7680f40cc963-crio-socket\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.161938 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:01.161660 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:01.661650804 +0000 UTC m=+140.111536916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : secret "insights-runtime-extractor-tls" not found Sep 17 17:37:01.161938 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.161793 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1d454c2-4885-4017-9132-7680f40cc963-data-volume\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.176146 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.176103 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd228\" (UniqueName: \"kubernetes.io/projected/b1d454c2-4885-4017-9132-7680f40cc963-kube-api-access-wd228\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.249009 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.248969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q" event={"ID":"52ea0606-0389-4f4d-8da2-c91a2c882a80","Type":"ContainerStarted","Data":"5df615793824b28c9f3c5e12188d4902dd27bbd8e7b25c3b9ce1d5d38f09ab95"} Sep 17 17:37:01.665826 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.665797 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.665917 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:01.665893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:01.665978 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:01.665956 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:37:01.666045 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:01.666031 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:02.666009844 +0000 UTC m=+141.115895953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : secret "insights-runtime-extractor-tls" not found Sep 17 17:37:01.666101 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:01.666060 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:37:01.666144 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:01.666113 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:02.666097633 +0000 UTC m=+141.115983743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : configmap "kube-rbac-proxy" not found Sep 17 17:37:02.255951 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:02.255910 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q" event={"ID":"52ea0606-0389-4f4d-8da2-c91a2c882a80","Type":"ContainerStarted","Data":"c1224feabfa28ca5494b0dc8d6a4cd4d95de15ffacce317ffdca0ab38f881fb6"} Sep 17 17:37:02.256344 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:02.255967 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q" event={"ID":"52ea0606-0389-4f4d-8da2-c91a2c882a80","Type":"ContainerStarted","Data":"0ad6358a2b011fa06e5ffb8f1d1650c0b40e762d75c0d55ba6bddd986f52a86e"} Sep 17 17:37:02.275410 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:02.275362 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-nnb5q" podStartSLOduration=2.19809386 podStartE2EDuration="3.275344535s" totalImagesPullingTime="1.077250675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:02.274723987 +0000 UTC m=+140.724610129" watchObservedRunningTime="2026-09-17 17:37:02.275344535 +0000 UTC m=+140.725230704" Sep 17 17:37:02.672970 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:02.672870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:02.672970 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:02.672941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:02.673203 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:02.673048 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:37:02.673203 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:02.673067 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:37:02.673203 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:02.673129 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:04.673109668 +0000 UTC m=+143.122995790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : secret "insights-runtime-extractor-tls" not found Sep 17 17:37:02.673203 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:02.673151 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:04.673142149 +0000 UTC m=+143.123028267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : configmap "kube-rbac-proxy" not found Sep 17 17:37:03.718751 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:03.718723 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mbvzt_34e63e2f-5e8b-410b-9df5-65e8686cd545/dns-node-resolver/0.log" Sep 17 17:37:03.881204 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:03.881139 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:37:03.881391 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:03.881213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:03.881391 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:03.881258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:37:03.881391 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:03.881291 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:37:03.881391 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:03.881313 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8479cf6c55-gkp67: secret "image-registry-tls" not found Sep 17 17:37:03.881391 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:03.881354 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:37:03.881391 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:03.881296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:03.881391 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:03.881360 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls podName:74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c nodeName:}" failed. No retries permitted until 2026-09-17 17:37:11.881346422 +0000 UTC m=+150.331232530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls") pod "image-registry-8479cf6c55-gkp67" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c") : secret "image-registry-tls" not found Sep 17 17:37:03.881667 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:03.881407 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 17:37:03.881667 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:03.881419 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:11.881405027 +0000 UTC m=+150.331291136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : configmap references non-existent config key: service-ca.crt Sep 17 17:37:03.881667 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:03.881433 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:11.881427334 +0000 UTC m=+150.331313442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : secret "router-metrics-certs-default" not found Sep 17 17:37:03.881667 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:03.881451 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls podName:939c3109-7819-4fe8-8dd9-187fa766aca7 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:11.881442251 +0000 UTC m=+150.331328361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-snhg2" (UID: "939c3109-7819-4fe8-8dd9-187fa766aca7") : secret "cluster-monitoring-operator-tls" not found Sep 17 17:37:04.520261 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:04.520232 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fm4h_62b695b7-eb68-45ac-8407-7f213aa2a087/node-ca/0.log" Sep 17 17:37:04.693136 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:04.693080 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:04.693300 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:04.693184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:04.693300 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:04.693236 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:37:04.693300 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:04.693254 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:37:04.693400 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:04.693301 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:08.693284868 +0000 UTC m=+147.143170976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : secret "insights-runtime-extractor-tls" not found Sep 17 17:37:04.693400 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:04.693315 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:08.693309171 +0000 UTC m=+147.143195279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : configmap "kube-rbac-proxy" not found Sep 17 17:37:05.315747 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:05.315721 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4fq65_ee20a8ad-6e24-40dd-b3ba-c3fcf1639375/serve-healthcheck-canary/0.log" Sep 17 17:37:05.918417 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:05.918382 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-nnb5q_52ea0606-0389-4f4d-8da2-c91a2c882a80/migrator/0.log" Sep 17 17:37:06.115536 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:06.115504 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-nnb5q_52ea0606-0389-4f4d-8da2-c91a2c882a80/graceful-termination/0.log" Sep 17 17:37:08.726558 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:08.726528 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:08.726981 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:08.726580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:08.726981 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:08.726645 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:37:08.726981 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:08.726692 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:16.726680302 +0000 UTC m=+155.176566409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : configmap "kube-rbac-proxy" not found Sep 17 17:37:08.726981 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:08.726696 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:37:08.726981 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:08.726759 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:16.726741213 +0000 UTC m=+155.176627344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : secret "insights-runtime-extractor-tls" not found Sep 17 17:37:11.953807 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:11.953760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:37:11.954212 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:11.953817 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:11.954212 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:11.953918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:37:11.954212 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:11.953926 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 17:37:11.954212 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:11.953952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:11.954212 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:11.954008 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls podName:939c3109-7819-4fe8-8dd9-187fa766aca7 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:27.953990294 +0000 UTC m=+166.403876415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-snhg2" (UID: "939c3109-7819-4fe8-8dd9-187fa766aca7") : secret "cluster-monitoring-operator-tls" not found Sep 17 17:37:11.954212 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:11.954051 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:27.954028539 +0000 UTC m=+166.403914669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : configmap references non-existent config key: service-ca.crt Sep 17 17:37:11.954212 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:11.954052 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:37:11.954212 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:11.954101 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs podName:e26f0b1b-8147-48a3-b742-07341db1c109 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:27.954090052 +0000 UTC m=+166.403976159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs") pod "router-default-85d7c9949b-98b2q" (UID: "e26f0b1b-8147-48a3-b742-07341db1c109") : secret "router-metrics-certs-default" not found Sep 17 17:37:11.956338 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:11.956317 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") pod \"image-registry-8479cf6c55-gkp67\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:37:11.998598 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:11.998565 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:37:12.295403 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:12.295353 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8479cf6c55-gkp67"] Sep 17 17:37:12.297596 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:12.297568 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e9b200_1da0_4f37_b4a6_09d5cb8f6a5c.slice/crio-6aecf900d95b139eb1137b554d880e94842b1d28e0a829ea12e9d37386edb8b4 WatchSource:0}: Error finding container 6aecf900d95b139eb1137b554d880e94842b1d28e0a829ea12e9d37386edb8b4: Status 404 returned error can't find the container with id 6aecf900d95b139eb1137b554d880e94842b1d28e0a829ea12e9d37386edb8b4 Sep 17 17:37:13.291307 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:13.291274 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" event={"ID":"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c","Type":"ContainerStarted","Data":"147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308"} Sep 17 17:37:13.291693 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:13.291319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" event={"ID":"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c","Type":"ContainerStarted","Data":"6aecf900d95b139eb1137b554d880e94842b1d28e0a829ea12e9d37386edb8b4"} Sep 17 17:37:13.291693 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:13.291400 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:37:13.322024 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:13.321975 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" podStartSLOduration=17.321958477 podStartE2EDuration="17.321958477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:13.320423201 +0000 UTC m=+151.770309330" watchObservedRunningTime="2026-09-17 17:37:13.321958477 +0000 UTC m=+151.771844648" Sep 17 17:37:16.794103 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:16.794071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:16.794507 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:16.794156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:16.794507 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:16.794261 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:37:16.794507 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:16.794309 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls podName:b1d454c2-4885-4017-9132-7680f40cc963 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:32.794295397 +0000 UTC m=+171.244181504 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l5lqq" (UID: "b1d454c2-4885-4017-9132-7680f40cc963") : secret "insights-runtime-extractor-tls" not found Sep 17 17:37:16.794634 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:16.794614 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d454c2-4885-4017-9132-7680f40cc963-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:21.561838 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:21.561786 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x8l9j" podUID="087b37b5-cb65-423a-b7f1-a95a764a45b4" Sep 17 17:37:21.757691 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:21.757655 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6ntvh" podUID="9b7c7317-0809-4f38-8acb-709a2f66913f" Sep 17 17:37:22.316718 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:22.316689 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x8l9j" Sep 17 17:37:26.568684 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:26.568591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:37:26.570838 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:26.570820 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/087b37b5-cb65-423a-b7f1-a95a764a45b4-metrics-tls\") pod \"dns-default-x8l9j\" (UID: \"087b37b5-cb65-423a-b7f1-a95a764a45b4\") " pod="openshift-dns/dns-default-x8l9j" Sep 17 17:37:26.821230 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:26.821151 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bqqq4\"" Sep 17 17:37:26.827420 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:26.827403 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x8l9j" Sep 17 17:37:27.104327 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:27.104253 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x8l9j"] Sep 17 17:37:27.107347 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:27.107313 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087b37b5_cb65_423a_b7f1_a95a764a45b4.slice/crio-fef0aaa6ca078dc9df1382208107dea2bbecc89e12de2a6fbc66c674deecc954 WatchSource:0}: Error finding container fef0aaa6ca078dc9df1382208107dea2bbecc89e12de2a6fbc66c674deecc954: Status 404 returned error can't find the container with id fef0aaa6ca078dc9df1382208107dea2bbecc89e12de2a6fbc66c674deecc954 Sep 17 17:37:27.334438 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:27.334409 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8l9j" event={"ID":"087b37b5-cb65-423a-b7f1-a95a764a45b4","Type":"ContainerStarted","Data":"fef0aaa6ca078dc9df1382208107dea2bbecc89e12de2a6fbc66c674deecc954"} Sep 17 17:37:27.982872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:27.982841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:27.983340 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:27.982880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:37:27.983340 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:27.982910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:27.983630 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:27.983607 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e26f0b1b-8147-48a3-b742-07341db1c109-service-ca-bundle\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:27.985657 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:27.985630 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/939c3109-7819-4fe8-8dd9-187fa766aca7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-snhg2\" (UID: \"939c3109-7819-4fe8-8dd9-187fa766aca7\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:37:27.985757 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:27.985701 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e26f0b1b-8147-48a3-b742-07341db1c109-metrics-certs\") pod \"router-default-85d7c9949b-98b2q\" (UID: \"e26f0b1b-8147-48a3-b742-07341db1c109\") " pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:28.186268 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:28.186228 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" Sep 17 17:37:28.204418 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:28.204388 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:28.820401 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:28.820331 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d7c9949b-98b2q"] Sep 17 17:37:28.821988 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:28.821956 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2"] Sep 17 17:37:28.824624 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:28.824599 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26f0b1b_8147_48a3_b742_07341db1c109.slice/crio-2e4f312bec108b3f3714f5ff87291a8041d3566f44deb85847a65c8db6ab650e WatchSource:0}: Error finding container 2e4f312bec108b3f3714f5ff87291a8041d3566f44deb85847a65c8db6ab650e: Status 404 returned error can't find the container with id 2e4f312bec108b3f3714f5ff87291a8041d3566f44deb85847a65c8db6ab650e Sep 17 17:37:28.826341 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:28.826290 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939c3109_7819_4fe8_8dd9_187fa766aca7.slice/crio-d25276bd3303aaded94ae6f1eb7d5c8a3036f596fb033837ea901af17337ef02 WatchSource:0}: Error finding container d25276bd3303aaded94ae6f1eb7d5c8a3036f596fb033837ea901af17337ef02: Status 404 returned error can't find the container with id d25276bd3303aaded94ae6f1eb7d5c8a3036f596fb033837ea901af17337ef02 Sep 17 17:37:29.341715 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.341672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d7c9949b-98b2q" event={"ID":"e26f0b1b-8147-48a3-b742-07341db1c109","Type":"ContainerStarted","Data":"6fab79f6221de66d7794693b282045fb71275b93e7dbcff6a43d3b6b7b95ecd4"} Sep 17 17:37:29.342184 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.341764 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d7c9949b-98b2q" event={"ID":"e26f0b1b-8147-48a3-b742-07341db1c109","Type":"ContainerStarted","Data":"2e4f312bec108b3f3714f5ff87291a8041d3566f44deb85847a65c8db6ab650e"} Sep 17 17:37:29.343365 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.343328 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8l9j" event={"ID":"087b37b5-cb65-423a-b7f1-a95a764a45b4","Type":"ContainerStarted","Data":"6b17bcecbcb273975c85f9ff8570339e73ee1549cc510684a966e12add1b517a"} Sep 17 17:37:29.343516 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.343376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8l9j" event={"ID":"087b37b5-cb65-423a-b7f1-a95a764a45b4","Type":"ContainerStarted","Data":"ebf693d62beae6a2599b20c00fce2e99ffe7974acd252944fc905eca40b92658"} Sep 17 17:37:29.343516 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.343404 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x8l9j" Sep 17 17:37:29.344486 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.344456 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" event={"ID":"939c3109-7819-4fe8-8dd9-187fa766aca7","Type":"ContainerStarted","Data":"d25276bd3303aaded94ae6f1eb7d5c8a3036f596fb033837ea901af17337ef02"} Sep 17 17:37:29.384163 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.384115 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85d7c9949b-98b2q" podStartSLOduration=33.384099737 podStartE2EDuration="33.384099737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:29.383504831 +0000 UTC m=+167.833390962" watchObservedRunningTime="2026-09-17 17:37:29.384099737 +0000 UTC m=+167.833985895" Sep 17 17:37:29.436577 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.436520 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x8l9j" podStartSLOduration=129.9626713 podStartE2EDuration="2m11.436501366s" totalImagesPullingTime="1.473830066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:29.435428214 +0000 UTC m=+167.885314345" watchObservedRunningTime="2026-09-17 17:37:29.436501366 +0000 UTC m=+167.886387493" Sep 17 17:37:29.611087 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.611009 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8479cf6c55-gkp67"] Sep 17 17:37:29.616382 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.616353 2562 patch_prober.go:28] interesting pod/image-registry-8479cf6c55-gkp67 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 17:37:29.616524 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.616398 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" podUID="74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:37:29.702031 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.701988 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b895b957-sxpz7"] Sep 17 17:37:29.704977 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.704962 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.777292 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.777251 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b895b957-sxpz7"] Sep 17 17:37:29.797247 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.797214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71cf254a-fa8f-4163-911b-85fc3061d103-ca-trust-extracted\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.797416 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.797259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9mmj\" (UniqueName: \"kubernetes.io/projected/71cf254a-fa8f-4163-911b-85fc3061d103-kube-api-access-n9mmj\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.797416 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.797296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71cf254a-fa8f-4163-911b-85fc3061d103-trusted-ca\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.797416 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.797325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71cf254a-fa8f-4163-911b-85fc3061d103-installation-pull-secrets\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.797416 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.797357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71cf254a-fa8f-4163-911b-85fc3061d103-image-registry-private-configuration\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.797416 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.797389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71cf254a-fa8f-4163-911b-85fc3061d103-registry-certificates\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.797668 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.797445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71cf254a-fa8f-4163-911b-85fc3061d103-registry-tls\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.797668 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.797468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71cf254a-fa8f-4163-911b-85fc3061d103-bound-sa-token\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.898720 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.898638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71cf254a-fa8f-4163-911b-85fc3061d103-ca-trust-extracted\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.898720 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.898682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mmj\" (UniqueName: \"kubernetes.io/projected/71cf254a-fa8f-4163-911b-85fc3061d103-kube-api-access-n9mmj\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.898720 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.898703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71cf254a-fa8f-4163-911b-85fc3061d103-trusted-ca\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.898985 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.898720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71cf254a-fa8f-4163-911b-85fc3061d103-installation-pull-secrets\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.898985 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.898790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71cf254a-fa8f-4163-911b-85fc3061d103-image-registry-private-configuration\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.898985 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.898821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71cf254a-fa8f-4163-911b-85fc3061d103-registry-certificates\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.898985 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.898911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71cf254a-fa8f-4163-911b-85fc3061d103-registry-tls\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.898985 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.898952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71cf254a-fa8f-4163-911b-85fc3061d103-bound-sa-token\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.899218 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.899085 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71cf254a-fa8f-4163-911b-85fc3061d103-ca-trust-extracted\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.899676 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.899653 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71cf254a-fa8f-4163-911b-85fc3061d103-registry-certificates\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.899796 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.899743 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71cf254a-fa8f-4163-911b-85fc3061d103-trusted-ca\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.901337 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.901307 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71cf254a-fa8f-4163-911b-85fc3061d103-image-registry-private-configuration\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.901417 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.901338 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71cf254a-fa8f-4163-911b-85fc3061d103-installation-pull-secrets\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.901417 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.901354 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71cf254a-fa8f-4163-911b-85fc3061d103-registry-tls\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.909393 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.909370 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9mmj\" (UniqueName: \"kubernetes.io/projected/71cf254a-fa8f-4163-911b-85fc3061d103-kube-api-access-n9mmj\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:29.910604 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:29.910589 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71cf254a-fa8f-4163-911b-85fc3061d103-bound-sa-token\") pod \"image-registry-6b895b957-sxpz7\" (UID: \"71cf254a-fa8f-4163-911b-85fc3061d103\") " pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:30.013755 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:30.013720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:30.205382 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:30.205290 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:30.208220 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:30.208196 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:30.297663 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:30.297622 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b895b957-sxpz7"] Sep 17 17:37:30.348880 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:30.348855 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:30.350259 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:30.350236 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85d7c9949b-98b2q" Sep 17 17:37:30.701501 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:30.701446 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71cf254a_fa8f_4163_911b_85fc3061d103.slice/crio-df6487460425bf6bf7b7e55dd5afb00bfdc1a827f5ae45dc0cde72f74d6baf37 WatchSource:0}: Error finding container df6487460425bf6bf7b7e55dd5afb00bfdc1a827f5ae45dc0cde72f74d6baf37: Status 404 returned error can't find the container with id df6487460425bf6bf7b7e55dd5afb00bfdc1a827f5ae45dc0cde72f74d6baf37 Sep 17 17:37:31.353835 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:31.353803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b895b957-sxpz7" event={"ID":"71cf254a-fa8f-4163-911b-85fc3061d103","Type":"ContainerStarted","Data":"17b231f57a742bfb1461fc5da2ed1a30a0c73d8fb39ae833aa80a1b4635da5fe"} Sep 17 17:37:31.354263 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:31.353851 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b895b957-sxpz7" event={"ID":"71cf254a-fa8f-4163-911b-85fc3061d103","Type":"ContainerStarted","Data":"df6487460425bf6bf7b7e55dd5afb00bfdc1a827f5ae45dc0cde72f74d6baf37"} Sep 17 17:37:31.354263 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:31.353912 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:31.355430 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:31.355402 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" event={"ID":"939c3109-7819-4fe8-8dd9-187fa766aca7","Type":"ContainerStarted","Data":"74e21b67dfdbd1009eb531f52bea6fba9f0109e2d5f1eb7bd481a2dff6d8904a"} Sep 17 17:37:31.384139 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:31.384091 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b895b957-sxpz7" podStartSLOduration=2.384077084 podStartE2EDuration="2.384077084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:31.383525095 +0000 UTC m=+169.833411225" watchObservedRunningTime="2026-09-17 17:37:31.384077084 +0000 UTC m=+169.833963249" Sep 17 17:37:32.821656 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:32.821612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:32.823852 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:32.823829 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d454c2-4885-4017-9132-7680f40cc963-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l5lqq\" (UID: \"b1d454c2-4885-4017-9132-7680f40cc963\") " pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:33.067806 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:33.067767 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l5lqq" Sep 17 17:37:33.344078 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:33.343986 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-snhg2" podStartSLOduration=35.423216682 podStartE2EDuration="37.34396902s" totalImagesPullingTime="1.920752338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:31.409121213 +0000 UTC m=+169.859007344" watchObservedRunningTime="2026-09-17 17:37:33.34396902 +0000 UTC m=+171.793855150" Sep 17 17:37:33.345042 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:33.345017 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l5lqq"] Sep 17 17:37:33.347972 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:33.347945 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d454c2_4885_4017_9132_7680f40cc963.slice/crio-86ea7f3a44f34323915d259b9dc54950495859974cc0c3086f873953777e3ad5 WatchSource:0}: Error finding container 86ea7f3a44f34323915d259b9dc54950495859974cc0c3086f873953777e3ad5: Status 404 returned error can't find the container with id 86ea7f3a44f34323915d259b9dc54950495859974cc0c3086f873953777e3ad5 Sep 17 17:37:33.364135 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:33.364109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5lqq" event={"ID":"b1d454c2-4885-4017-9132-7680f40cc963","Type":"ContainerStarted","Data":"86ea7f3a44f34323915d259b9dc54950495859974cc0c3086f873953777e3ad5"} Sep 17 17:37:34.369132 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:34.369096 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5lqq" event={"ID":"b1d454c2-4885-4017-9132-7680f40cc963","Type":"ContainerStarted","Data":"fc4b236d70e3d6df1838871c6a5b7e3f7216c102f28f0d656ce7efe1244c68c9"} Sep 17 17:37:34.369525 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:34.369154 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5lqq" event={"ID":"b1d454c2-4885-4017-9132-7680f40cc963","Type":"ContainerStarted","Data":"e3fb027c619cb740d025b3001fe5e47698c496dd2d5894274d6a3c2123a93dfe"} Sep 17 17:37:35.374210 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:35.374181 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l5lqq" event={"ID":"b1d454c2-4885-4017-9132-7680f40cc963","Type":"ContainerStarted","Data":"4ffb65dbd2ffc09d483d0c1a5570909848c7f583fec519619226a05e26079965"} Sep 17 17:37:35.393791 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:35.393747 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l5lqq" podStartSLOduration=33.56162041 podStartE2EDuration="35.393731784s" totalImagesPullingTime="1.832111374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:37:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:35.392645287 +0000 UTC m=+173.842531428" watchObservedRunningTime="2026-09-17 17:37:35.393731784 +0000 UTC m=+173.843617913" Sep 17 17:37:35.748600 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:35.748571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:37:39.350976 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:39.350936 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x8l9j" Sep 17 17:37:39.615196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:39.615118 2562 patch_prober.go:28] interesting pod/image-registry-8479cf6c55-gkp67 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 17:37:39.615196 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:39.615174 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" podUID="74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 17:37:40.810108 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.810068 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-htskq"] Sep 17 17:37:40.815150 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.815124 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.817486 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.817456 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 17:37:40.817582 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.817458 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 17:37:40.817582 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.817458 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sg5vz\"" Sep 17 17:37:40.817699 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.817684 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 17:37:40.818265 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.818248 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 17:37:40.886309 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.886278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e56a97e-3663-4662-a6c5-da290b929a12-metrics-client-ca\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.886468 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.886321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-wtmp\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.886468 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.886344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.886468 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.886368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e56a97e-3663-4662-a6c5-da290b929a12-sys\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.886468 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.886424 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-tls\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.886468 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.886448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-accelerators-collector-config\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.886709 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.886497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-textfile\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.886709 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.886523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd6jp\" (UniqueName: \"kubernetes.io/projected/1e56a97e-3663-4662-a6c5-da290b929a12-kube-api-access-wd6jp\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.886709 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.886548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e56a97e-3663-4662-a6c5-da290b929a12-root\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987236 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e56a97e-3663-4662-a6c5-da290b929a12-metrics-client-ca\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987236 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-wtmp\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e56a97e-3663-4662-a6c5-da290b929a12-sys\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-tls\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-accelerators-collector-config\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-textfile\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987408 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-wtmp\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987415 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e56a97e-3663-4662-a6c5-da290b929a12-sys\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987760 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6jp\" (UniqueName: \"kubernetes.io/projected/1e56a97e-3663-4662-a6c5-da290b929a12-kube-api-access-wd6jp\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987760 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e56a97e-3663-4662-a6c5-da290b929a12-root\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987760 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:40.987547 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 17:37:40.987760 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987590 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e56a97e-3663-4662-a6c5-da290b929a12-root\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987760 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:40.987615 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-tls podName:1e56a97e-3663-4662-a6c5-da290b929a12 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:41.487595511 +0000 UTC m=+179.937481633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-tls") pod "node-exporter-htskq" (UID: "1e56a97e-3663-4662-a6c5-da290b929a12") : secret "node-exporter-tls" not found Sep 17 17:37:40.987976 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987868 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e56a97e-3663-4662-a6c5-da290b929a12-metrics-client-ca\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987976 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987866 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-textfile\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.987976 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.987964 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-accelerators-collector-config\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:40.989726 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:40.989709 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:41.002317 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.002288 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd6jp\" (UniqueName: \"kubernetes.io/projected/1e56a97e-3663-4662-a6c5-da290b929a12-kube-api-access-wd6jp\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:41.492144 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.492106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-tls\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:41.494817 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.494793 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e56a97e-3663-4662-a6c5-da290b929a12-node-exporter-tls\") pod \"node-exporter-htskq\" (UID: \"1e56a97e-3663-4662-a6c5-da290b929a12\") " pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:41.724817 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.724783 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-htskq" Sep 17 17:37:41.900446 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.900414 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:37:41.905029 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.905011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.907927 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.907907 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 17:37:41.908025 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.907936 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 17:37:41.908025 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.907936 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 17:37:41.908197 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.908181 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hjrvd\"" Sep 17 17:37:41.908249 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.908211 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 17:37:41.908249 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.908187 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 17:37:41.908441 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.908425 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 17:37:41.908512 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.908453 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 17:37:41.912298 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.912070 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 17:37:41.913957 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.913940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 17:37:41.919898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.919878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:37:41.997139 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-web-config\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997139 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997139 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997409 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997409 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997409 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997409 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997409 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997409 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997409 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997673 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997673 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4bmw\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-kube-api-access-p4bmw\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:41.997673 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:41.997522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-out\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098147 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098319 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098319 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098319 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098319 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098545 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4bmw\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-kube-api-access-p4bmw\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098545 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-out\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098545 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-web-config\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098689 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098689 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098689 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098689 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098689 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.098926 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.098741 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.099793 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.099520 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.099920 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.099847 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.101404 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.101199 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.101523 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.101399 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.101592 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.101560 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.101996 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.101957 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.102226 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.102206 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.102455 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.102429 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-out\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.102822 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.102800 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.102930 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.102851 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.103786 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.103757 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-web-config\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.109156 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.109129 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4bmw\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-kube-api-access-p4bmw\") pod \"alertmanager-main-0\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.214996 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.214957 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:37:42.400682 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.400641 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htskq" event={"ID":"1e56a97e-3663-4662-a6c5-da290b929a12","Type":"ContainerStarted","Data":"1151e0d0af57a93e065a05ff119ec1b504732f3d7847bbe2497cfb71f0cbd1d2"} Sep 17 17:37:42.515490 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:42.515433 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:37:42.592158 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:42.592092 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d9f59f_465c_463f_bf83_f842efb2eb4b.slice/crio-9ebc2839211b864b328f8e34c5e7ea2fe8ff84af8bb3d154a077213081525c1e WatchSource:0}: Error finding container 9ebc2839211b864b328f8e34c5e7ea2fe8ff84af8bb3d154a077213081525c1e: Status 404 returned error can't find the container with id 9ebc2839211b864b328f8e34c5e7ea2fe8ff84af8bb3d154a077213081525c1e Sep 17 17:37:43.405814 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:43.405777 2562 generic.go:356] "Generic (PLEG): container finished" podID="1e56a97e-3663-4662-a6c5-da290b929a12" containerID="84d53a43d2acddbf6bbce67565c8add45bfed502bebfb5a57b934f68e9db5e1f" exitCode=0 Sep 17 17:37:43.406287 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:43.405871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htskq" event={"ID":"1e56a97e-3663-4662-a6c5-da290b929a12","Type":"ContainerDied","Data":"84d53a43d2acddbf6bbce67565c8add45bfed502bebfb5a57b934f68e9db5e1f"} Sep 17 17:37:43.407291 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:43.407268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerStarted","Data":"9ebc2839211b864b328f8e34c5e7ea2fe8ff84af8bb3d154a077213081525c1e"} Sep 17 17:37:44.412528 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:44.412463 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htskq" event={"ID":"1e56a97e-3663-4662-a6c5-da290b929a12","Type":"ContainerStarted","Data":"234c479bca4232510303a63c52036d758714433732aad3564aa1ac1cf0c86b6b"} Sep 17 17:37:44.413001 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:44.412587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htskq" event={"ID":"1e56a97e-3663-4662-a6c5-da290b929a12","Type":"ContainerStarted","Data":"959063cef2da36aa4890306ca45fb72a212385fc3863ae554cc4b647bd733b29"} Sep 17 17:37:44.413888 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:44.413863 2562 generic.go:356] "Generic (PLEG): container finished" podID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerID="e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3" exitCode=0 Sep 17 17:37:44.413987 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:44.413931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerDied","Data":"e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3"} Sep 17 17:37:44.437499 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:44.437429 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-htskq" podStartSLOduration=3.481777804 podStartE2EDuration="4.437414599s" totalImagesPullingTime="895.126251ms" totalInitContainerRuntime="60.510544ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:44.435924862 +0000 UTC m=+182.885810991" watchObservedRunningTime="2026-09-17 17:37:44.437414599 +0000 UTC m=+182.887300775" Sep 17 17:37:45.195941 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.195906 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz"] Sep 17 17:37:45.199161 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.199137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.203796 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.203765 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 17:37:45.204025 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.204003 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 17:37:45.204111 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.204070 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rwwcs\"" Sep 17 17:37:45.204208 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.204184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 17:37:45.204339 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.204324 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 17:37:45.204866 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.204840 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7nieupktt9idk\"" Sep 17 17:37:45.218104 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.218085 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz"] Sep 17 17:37:45.324772 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.324736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bf7bd9c9-d157-4711-9967-942c2afa1ae2-secret-metrics-server-tls\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.324772 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.324780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bf7bd9c9-d157-4711-9967-942c2afa1ae2-metrics-server-audit-profiles\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.325003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.324812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bf7bd9c9-d157-4711-9967-942c2afa1ae2-secret-metrics-server-client-certs\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.325003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.324907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf7bd9c9-d157-4711-9967-942c2afa1ae2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.325003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.324956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf7bd9c9-d157-4711-9967-942c2afa1ae2-client-ca-bundle\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.325113 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.325038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwtl6\" (UniqueName: \"kubernetes.io/projected/bf7bd9c9-d157-4711-9967-942c2afa1ae2-kube-api-access-bwtl6\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.325113 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.325102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bf7bd9c9-d157-4711-9967-942c2afa1ae2-audit-log\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.426036 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.425999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf7bd9c9-d157-4711-9967-942c2afa1ae2-client-ca-bundle\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.426529 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.426055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwtl6\" (UniqueName: \"kubernetes.io/projected/bf7bd9c9-d157-4711-9967-942c2afa1ae2-kube-api-access-bwtl6\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.426529 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.426101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bf7bd9c9-d157-4711-9967-942c2afa1ae2-audit-log\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.426529 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.426137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bf7bd9c9-d157-4711-9967-942c2afa1ae2-secret-metrics-server-tls\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.426529 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.426163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bf7bd9c9-d157-4711-9967-942c2afa1ae2-metrics-server-audit-profiles\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.426529 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.426438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bf7bd9c9-d157-4711-9967-942c2afa1ae2-secret-metrics-server-client-certs\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.426529 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.426525 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf7bd9c9-d157-4711-9967-942c2afa1ae2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.426853 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.426592 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bf7bd9c9-d157-4711-9967-942c2afa1ae2-audit-log\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.427231 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.427183 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf7bd9c9-d157-4711-9967-942c2afa1ae2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.427346 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.427229 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bf7bd9c9-d157-4711-9967-942c2afa1ae2-metrics-server-audit-profiles\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.428884 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.428852 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf7bd9c9-d157-4711-9967-942c2afa1ae2-client-ca-bundle\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.429029 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.429004 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bf7bd9c9-d157-4711-9967-942c2afa1ae2-secret-metrics-server-tls\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.429205 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.429188 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bf7bd9c9-d157-4711-9967-942c2afa1ae2-secret-metrics-server-client-certs\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.445345 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.445321 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwtl6\" (UniqueName: \"kubernetes.io/projected/bf7bd9c9-d157-4711-9967-942c2afa1ae2-kube-api-access-bwtl6\") pod \"metrics-server-6c74c4b5f5-9rhxz\" (UID: \"bf7bd9c9-d157-4711-9967-942c2afa1ae2\") " pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.509914 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.509881 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:37:45.591966 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.591933 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh"] Sep 17 17:37:45.594898 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.594875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:45.598591 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.597888 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 17:37:45.598591 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.597912 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dps4v\"" Sep 17 17:37:45.610654 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.610631 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh"] Sep 17 17:37:45.730072 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.730046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bhn7\" (UniqueName: \"kubernetes.io/projected/48122271-75ad-4f4d-abe0-401d049e82c9-kube-api-access-2bhn7\") pod \"monitoring-plugin-5984459ff8-hn9wh\" (UID: \"48122271-75ad-4f4d-abe0-401d049e82c9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:45.730172 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.730099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48122271-75ad-4f4d-abe0-401d049e82c9-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-hn9wh\" (UID: \"48122271-75ad-4f4d-abe0-401d049e82c9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:45.830947 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.830913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bhn7\" (UniqueName: \"kubernetes.io/projected/48122271-75ad-4f4d-abe0-401d049e82c9-kube-api-access-2bhn7\") pod \"monitoring-plugin-5984459ff8-hn9wh\" (UID: \"48122271-75ad-4f4d-abe0-401d049e82c9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:45.831042 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.830977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48122271-75ad-4f4d-abe0-401d049e82c9-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-hn9wh\" (UID: \"48122271-75ad-4f4d-abe0-401d049e82c9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:45.831191 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:45.831169 2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 17 17:37:45.831281 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:45.831249 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48122271-75ad-4f4d-abe0-401d049e82c9-monitoring-plugin-cert podName:48122271-75ad-4f4d-abe0-401d049e82c9 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:46.33122973 +0000 UTC m=+184.781115839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/48122271-75ad-4f4d-abe0-401d049e82c9-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-hn9wh" (UID: "48122271-75ad-4f4d-abe0-401d049e82c9") : secret "monitoring-plugin-cert" not found Sep 17 17:37:45.842777 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.842755 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz"] Sep 17 17:37:45.845572 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:45.845550 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bhn7\" (UniqueName: \"kubernetes.io/projected/48122271-75ad-4f4d-abe0-401d049e82c9-kube-api-access-2bhn7\") pod \"monitoring-plugin-5984459ff8-hn9wh\" (UID: \"48122271-75ad-4f4d-abe0-401d049e82c9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:45.848441 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:45.848413 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7bd9c9_d157_4711_9967_942c2afa1ae2.slice/crio-1a37768dcab9c9953fd55b34ff701c56b93cef04105310e61e6ed5582be2a1b8 WatchSource:0}: Error finding container 1a37768dcab9c9953fd55b34ff701c56b93cef04105310e61e6ed5582be2a1b8: Status 404 returned error can't find the container with id 1a37768dcab9c9953fd55b34ff701c56b93cef04105310e61e6ed5582be2a1b8 Sep 17 17:37:46.334806 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.334763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48122271-75ad-4f4d-abe0-401d049e82c9-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-hn9wh\" (UID: \"48122271-75ad-4f4d-abe0-401d049e82c9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:46.337850 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.337823 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/48122271-75ad-4f4d-abe0-401d049e82c9-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-hn9wh\" (UID: \"48122271-75ad-4f4d-abe0-401d049e82c9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:46.426442 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.426406 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerStarted","Data":"547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5"} Sep 17 17:37:46.426970 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.426503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerStarted","Data":"43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0"} Sep 17 17:37:46.426970 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.426549 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerStarted","Data":"252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62"} Sep 17 17:37:46.426970 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.426586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerStarted","Data":"c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d"} Sep 17 17:37:46.426970 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.426624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerStarted","Data":"4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c"} Sep 17 17:37:46.427697 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.427664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" event={"ID":"bf7bd9c9-d157-4711-9967-942c2afa1ae2","Type":"ContainerStarted","Data":"1a37768dcab9c9953fd55b34ff701c56b93cef04105310e61e6ed5582be2a1b8"} Sep 17 17:37:46.508537 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.508501 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:46.839082 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:46.838990 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh"] Sep 17 17:37:47.104127 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:47.104055 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48122271_75ad_4f4d_abe0_401d049e82c9.slice/crio-688b0129292a6d2632c3e9ce18a27952b672c9e1b447aa439a1ffe024ee5858f WatchSource:0}: Error finding container 688b0129292a6d2632c3e9ce18a27952b672c9e1b447aa439a1ffe024ee5858f: Status 404 returned error can't find the container with id 688b0129292a6d2632c3e9ce18a27952b672c9e1b447aa439a1ffe024ee5858f Sep 17 17:37:47.439909 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:47.439823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerStarted","Data":"668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f"} Sep 17 17:37:47.441139 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:47.441114 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" event={"ID":"48122271-75ad-4f4d-abe0-401d049e82c9","Type":"ContainerStarted","Data":"688b0129292a6d2632c3e9ce18a27952b672c9e1b447aa439a1ffe024ee5858f"} Sep 17 17:37:47.442542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:47.442520 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" event={"ID":"bf7bd9c9-d157-4711-9967-942c2afa1ae2","Type":"ContainerStarted","Data":"313eee4886d4e8f93bea86de0e4f172d7070337a8f6a202319ea4ac201feb4eb"} Sep 17 17:37:47.596664 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:47.596576 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" podStartSLOduration=1.298495624 podStartE2EDuration="2.596556155s" totalImagesPullingTime="1.298060531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:47.595884518 +0000 UTC m=+186.045770649" watchObservedRunningTime="2026-09-17 17:37:47.596556155 +0000 UTC m=+186.046442283" Sep 17 17:37:47.597201 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:47.597160 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.614872374 podStartE2EDuration="6.597145067s" totalImagesPullingTime="2.967171905s" totalInitContainerRuntime="15.100788ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:47.553248515 +0000 UTC m=+186.003134673" watchObservedRunningTime="2026-09-17 17:37:47.597145067 +0000 UTC m=+186.047031199" Sep 17 17:37:48.448151 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:48.448113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" event={"ID":"48122271-75ad-4f4d-abe0-401d049e82c9","Type":"ContainerStarted","Data":"7b0784f061664f13c46036cc124dc4cef4df265dc221c9c991abd8d8c01b8efb"} Sep 17 17:37:48.467360 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:48.467315 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" podStartSLOduration=2.317932311 podStartE2EDuration="3.467300804s" totalImagesPullingTime="1.149368493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:48.466049661 +0000 UTC m=+186.915935790" watchObservedRunningTime="2026-09-17 17:37:48.467300804 +0000 UTC m=+186.917186934" Sep 17 17:37:49.451574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:49.451541 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:49.456403 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:49.456376 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-hn9wh" Sep 17 17:37:49.615840 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:49.615813 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:37:52.164451 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.164414 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-k5cm2"] Sep 17 17:37:52.167906 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.167888 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-k5cm2" Sep 17 17:37:52.170825 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.170808 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fwrdw\"" Sep 17 17:37:52.170917 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.170878 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 17:37:52.171320 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.171308 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 17:37:52.186149 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.186126 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-k5cm2"] Sep 17 17:37:52.285758 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.285720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knw8c\" (UniqueName: \"kubernetes.io/projected/9c5ee19c-eb6a-46c3-aa2a-c7a1114514dd-kube-api-access-knw8c\") pod \"downloads-6594f4c75-k5cm2\" (UID: \"9c5ee19c-eb6a-46c3-aa2a-c7a1114514dd\") " pod="openshift-console/downloads-6594f4c75-k5cm2" Sep 17 17:37:52.363426 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.363397 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b895b957-sxpz7" Sep 17 17:37:52.386816 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.386785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knw8c\" (UniqueName: \"kubernetes.io/projected/9c5ee19c-eb6a-46c3-aa2a-c7a1114514dd-kube-api-access-knw8c\") pod \"downloads-6594f4c75-k5cm2\" (UID: \"9c5ee19c-eb6a-46c3-aa2a-c7a1114514dd\") " pod="openshift-console/downloads-6594f4c75-k5cm2" Sep 17 17:37:52.401326 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.401297 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knw8c\" (UniqueName: \"kubernetes.io/projected/9c5ee19c-eb6a-46c3-aa2a-c7a1114514dd-kube-api-access-knw8c\") pod \"downloads-6594f4c75-k5cm2\" (UID: \"9c5ee19c-eb6a-46c3-aa2a-c7a1114514dd\") " pod="openshift-console/downloads-6594f4c75-k5cm2" Sep 17 17:37:52.476533 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.476459 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-k5cm2" Sep 17 17:37:52.748535 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:52.748502 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-k5cm2"] Sep 17 17:37:52.751674 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:52.751647 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5ee19c_eb6a_46c3_aa2a_c7a1114514dd.slice/crio-f9c862bba01a73e2908ef765ac5b8aee586a6ea023375513e9aefda6bc5e06de WatchSource:0}: Error finding container f9c862bba01a73e2908ef765ac5b8aee586a6ea023375513e9aefda6bc5e06de: Status 404 returned error can't find the container with id f9c862bba01a73e2908ef765ac5b8aee586a6ea023375513e9aefda6bc5e06de Sep 17 17:37:53.466976 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:53.466943 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-k5cm2" event={"ID":"9c5ee19c-eb6a-46c3-aa2a-c7a1114514dd","Type":"ContainerStarted","Data":"f9c862bba01a73e2908ef765ac5b8aee586a6ea023375513e9aefda6bc5e06de"} Sep 17 17:37:54.629990 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:54.629919 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" podUID="74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" containerName="registry" containerID="cri-o://147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308" gracePeriod=30 Sep 17 17:37:54.883081 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:54.883015 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:37:55.009798 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.009754 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-bound-sa-token\") pod \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " Sep 17 17:37:55.009980 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.009824 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-installation-pull-secrets\") pod \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " Sep 17 17:37:55.009980 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.009937 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqbg2\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-kube-api-access-nqbg2\") pod \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " Sep 17 17:37:55.010100 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.009981 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-trusted-ca\") pod \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " Sep 17 17:37:55.010100 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.010037 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-image-registry-private-configuration\") pod \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " Sep 17 17:37:55.010100 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.010087 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-certificates\") pod \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " Sep 17 17:37:55.010243 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.010116 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-ca-trust-extracted\") pod \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " Sep 17 17:37:55.010243 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.010151 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") pod \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\" (UID: \"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c\") " Sep 17 17:37:55.010669 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.010546 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:37:55.010877 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.010756 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:37:55.012671 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.012626 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:37:55.012790 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.012766 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:37:55.012856 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.012785 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-kube-api-access-nqbg2" (OuterVolumeSpecName: "kube-api-access-nqbg2") pod "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c"). InnerVolumeSpecName "kube-api-access-nqbg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:37:55.012856 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.012824 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:37:55.013043 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.013019 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:37:55.020205 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.020183 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" (UID: "74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:37:55.111735 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.111688 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-tls\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:37:55.111735 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.111731 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-bound-sa-token\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:37:55.111912 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.111747 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-installation-pull-secrets\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:37:55.111912 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.111764 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqbg2\" (UniqueName: \"kubernetes.io/projected/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-kube-api-access-nqbg2\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:37:55.111912 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.111777 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-trusted-ca\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:37:55.111912 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.111793 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-image-registry-private-configuration\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:37:55.111912 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.111807 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-registry-certificates\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:37:55.111912 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.111821 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c-ca-trust-extracted\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:37:55.477396 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.477356 2562 generic.go:356] "Generic (PLEG): container finished" podID="74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" containerID="147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308" exitCode=0 Sep 17 17:37:55.477396 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.477397 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" event={"ID":"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c","Type":"ContainerDied","Data":"147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308"} Sep 17 17:37:55.477677 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.477415 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" Sep 17 17:37:55.477677 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.477468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8479cf6c55-gkp67" event={"ID":"74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c","Type":"ContainerDied","Data":"6aecf900d95b139eb1137b554d880e94842b1d28e0a829ea12e9d37386edb8b4"} Sep 17 17:37:55.477677 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.477525 2562 scope.go:117] "RemoveContainer" containerID="147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308" Sep 17 17:37:55.490586 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.490563 2562 scope.go:117] "RemoveContainer" containerID="147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308" Sep 17 17:37:55.491004 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:37:55.490979 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308\": container with ID starting with 147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308 not found: ID does not exist" containerID="147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308" Sep 17 17:37:55.491103 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.491015 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308"} err="failed to get container status \"147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308\": rpc error: code = NotFound desc = could not find container \"147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308\": container with ID starting with 147c1cca228eea158b2f9b8bef2b4c0641e383b5d18b55a92a4ef540dd00f308 not found: ID does not exist" Sep 17 17:37:55.506817 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.506786 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8479cf6c55-gkp67"] Sep 17 17:37:55.509816 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.509784 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8479cf6c55-gkp67"] Sep 17 17:37:55.754312 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:55.754275 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" path="/var/lib/kubelet/pods/74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c/volumes" Sep 17 17:37:58.804325 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.804296 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59b84b54b9-fc4j9"] Sep 17 17:37:58.804803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.804657 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" containerName="registry" Sep 17 17:37:58.804803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.804674 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" containerName="registry" Sep 17 17:37:58.804803 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.804763 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e9b200-1da0-4f37-b4a6-09d5cb8f6a5c" containerName="registry" Sep 17 17:37:58.810909 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.810882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:58.814096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.814069 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 17:37:58.814263 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.814073 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 17:37:58.814614 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.814591 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-22rdt\"" Sep 17 17:37:58.814782 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.814639 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 17:37:58.814948 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.814931 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 17:37:58.815029 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.814934 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 17:37:58.823763 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.823720 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b84b54b9-fc4j9"] Sep 17 17:37:58.946141 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.946089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-oauth-config\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:58.946141 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.946140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-oauth-serving-cert\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:58.946368 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.946168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-service-ca\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:58.946368 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.946227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-serving-cert\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:58.946368 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.946295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-config\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:58.946368 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:58.946344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vj9\" (UniqueName: \"kubernetes.io/projected/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-kube-api-access-62vj9\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.047677 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.047639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-oauth-config\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.047677 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.047682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-oauth-serving-cert\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.047932 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.047727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-service-ca\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.047932 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.047777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-serving-cert\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.047932 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.047839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-config\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.047932 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.047878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62vj9\" (UniqueName: \"kubernetes.io/projected/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-kube-api-access-62vj9\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.048591 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.048562 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-oauth-serving-cert\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.048695 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.048568 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-service-ca\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.048695 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.048610 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-config\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.050366 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.050346 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-oauth-config\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.050588 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.050569 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-serving-cert\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.058237 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.058163 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vj9\" (UniqueName: \"kubernetes.io/projected/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-kube-api-access-62vj9\") pod \"console-59b84b54b9-fc4j9\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.122866 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.122817 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:37:59.415526 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.415420 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b84b54b9-fc4j9"] Sep 17 17:37:59.418771 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:37:59.418736 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2086e9f6_3df4_4f72_b29a_3a19d7c31cad.slice/crio-d95c6b6f57c3ee9c7877821d390f782cdc753f7854130f2ad8f2eb35371e0c73 WatchSource:0}: Error finding container d95c6b6f57c3ee9c7877821d390f782cdc753f7854130f2ad8f2eb35371e0c73: Status 404 returned error can't find the container with id d95c6b6f57c3ee9c7877821d390f782cdc753f7854130f2ad8f2eb35371e0c73 Sep 17 17:37:59.497364 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:37:59.497325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b84b54b9-fc4j9" event={"ID":"2086e9f6-3df4-4f72-b29a-3a19d7c31cad","Type":"ContainerStarted","Data":"d95c6b6f57c3ee9c7877821d390f782cdc753f7854130f2ad8f2eb35371e0c73"} Sep 17 17:38:05.510990 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:05.510948 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:38:05.511583 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:05.511048 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:38:09.873804 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.873761 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b44b8fc68-vktdb"] Sep 17 17:38:09.878434 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.878413 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:09.889433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.889408 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 17:38:09.893320 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.893294 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b44b8fc68-vktdb"] Sep 17 17:38:09.951821 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.951783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-oauth-config\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:09.952015 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.951850 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-serving-cert\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:09.952015 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.951883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-config\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:09.952124 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.952039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-trusted-ca-bundle\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:09.952124 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.952091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-service-ca\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:09.952233 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.952120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m998\" (UniqueName: \"kubernetes.io/projected/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-kube-api-access-6m998\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:09.952233 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:09.952149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-oauth-serving-cert\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.053445 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.053406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m998\" (UniqueName: \"kubernetes.io/projected/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-kube-api-access-6m998\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.053652 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.053454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-oauth-serving-cert\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.053652 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.053494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-oauth-config\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.053652 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.053529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-serving-cert\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.053652 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.053560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-config\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.053871 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.053659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-trusted-ca-bundle\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.053871 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.053699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-service-ca\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.054296 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.054261 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-oauth-serving-cert\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.054705 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.054677 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-config\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.054791 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.054756 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-service-ca\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.054986 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.054965 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-trusted-ca-bundle\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.056470 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.056450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-oauth-config\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.056605 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.056578 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-serving-cert\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.063632 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.063602 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m998\" (UniqueName: \"kubernetes.io/projected/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-kube-api-access-6m998\") pod \"console-5b44b8fc68-vktdb\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:10.190134 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:10.190041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:11.219277 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.219168 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b44b8fc68-vktdb"] Sep 17 17:38:11.222168 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:38:11.222125 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34bb58d_8c4f_46ae_842b_ef0cb49d08e3.slice/crio-21fd305ecca7670b7a91db79138e2ede719f9d0371018ea663e516de619b8d14 WatchSource:0}: Error finding container 21fd305ecca7670b7a91db79138e2ede719f9d0371018ea663e516de619b8d14: Status 404 returned error can't find the container with id 21fd305ecca7670b7a91db79138e2ede719f9d0371018ea663e516de619b8d14 Sep 17 17:38:11.562394 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.562339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-k5cm2" event={"ID":"9c5ee19c-eb6a-46c3-aa2a-c7a1114514dd","Type":"ContainerStarted","Data":"b81ef6a04a6ef2c277dfcff443ee3b246ee9c65c17e903c48e8cf86d0ea4f263"} Sep 17 17:38:11.562603 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.562415 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-k5cm2" Sep 17 17:38:11.564682 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.564514 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b84b54b9-fc4j9" event={"ID":"2086e9f6-3df4-4f72-b29a-3a19d7c31cad","Type":"ContainerStarted","Data":"622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3"} Sep 17 17:38:11.566350 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.566320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b44b8fc68-vktdb" event={"ID":"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3","Type":"ContainerStarted","Data":"3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439"} Sep 17 17:38:11.566451 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.566364 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b44b8fc68-vktdb" event={"ID":"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3","Type":"ContainerStarted","Data":"21fd305ecca7670b7a91db79138e2ede719f9d0371018ea663e516de619b8d14"} Sep 17 17:38:11.575023 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.574991 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-k5cm2" Sep 17 17:38:11.585295 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.585241 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-k5cm2" podStartSLOduration=1.323806872 podStartE2EDuration="19.585221785s" totalImagesPullingTime="18.261414913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:11.583220341 +0000 UTC m=+210.033106472" watchObservedRunningTime="2026-09-17 17:38:11.585221785 +0000 UTC m=+210.035107918" Sep 17 17:38:11.623211 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.623142 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59b84b54b9-fc4j9" podStartSLOduration=2.091164581 podStartE2EDuration="13.623115829s" totalImagesPullingTime="11.531951248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:11.621022203 +0000 UTC m=+210.070908334" watchObservedRunningTime="2026-09-17 17:38:11.623115829 +0000 UTC m=+210.073001960" Sep 17 17:38:11.646210 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:11.645129 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b44b8fc68-vktdb" podStartSLOduration=2.6451034460000002 podStartE2EDuration="2.645103446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:38:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:11.643910369 +0000 UTC m=+210.093796499" watchObservedRunningTime="2026-09-17 17:38:11.645103446 +0000 UTC m=+210.094989591" Sep 17 17:38:19.123162 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:19.123119 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:38:19.123759 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:19.123192 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:38:19.128285 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:19.128259 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:38:19.606711 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:19.606681 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:38:20.190705 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:20.190662 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:20.191110 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:20.190717 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:20.195439 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:20.195416 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:20.609840 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:20.609810 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:38:20.660551 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:20.660503 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b84b54b9-fc4j9"] Sep 17 17:38:25.516401 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:25.516371 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:38:25.523548 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:25.523522 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c74c4b5f5-9rhxz" Sep 17 17:38:25.626787 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:25.626751 2562 generic.go:356] "Generic (PLEG): container finished" podID="956d69c2-e84d-4f8f-be9e-4f0ceadc534e" containerID="68a571bb41ecd3032a0973923ebab683d1662e00cfb8805eb816fa0563cd84d1" exitCode=0 Sep 17 17:38:25.626959 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:25.626794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" event={"ID":"956d69c2-e84d-4f8f-be9e-4f0ceadc534e","Type":"ContainerDied","Data":"68a571bb41ecd3032a0973923ebab683d1662e00cfb8805eb816fa0563cd84d1"} Sep 17 17:38:25.627257 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:25.627245 2562 scope.go:117] "RemoveContainer" containerID="68a571bb41ecd3032a0973923ebab683d1662e00cfb8805eb816fa0563cd84d1" Sep 17 17:38:26.632558 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:26.632522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ccfxr" event={"ID":"956d69c2-e84d-4f8f-be9e-4f0ceadc534e","Type":"ContainerStarted","Data":"4e58c68c2df7aa9e75ae76dffed78c784cf229566eaf656de2a72b4d67c4ed01"} Sep 17 17:38:30.652866 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:30.652834 2562 generic.go:356] "Generic (PLEG): container finished" podID="b702e320-39d6-43cd-aecb-3fdac70f15fb" containerID="ead4261bcc8a71e4f7d6173a5666a90b4fef8bf6b98bde2eccae5ed90ab43174" exitCode=0 Sep 17 17:38:30.653315 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:30.652907 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" event={"ID":"b702e320-39d6-43cd-aecb-3fdac70f15fb","Type":"ContainerDied","Data":"ead4261bcc8a71e4f7d6173a5666a90b4fef8bf6b98bde2eccae5ed90ab43174"} Sep 17 17:38:30.653315 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:30.653243 2562 scope.go:117] "RemoveContainer" containerID="ead4261bcc8a71e4f7d6173a5666a90b4fef8bf6b98bde2eccae5ed90ab43174" Sep 17 17:38:31.340224 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:31.340197 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8l9j_087b37b5-cb65-423a-b7f1-a95a764a45b4/dns/0.log" Sep 17 17:38:31.348655 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:31.348624 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8l9j_087b37b5-cb65-423a-b7f1-a95a764a45b4/kube-rbac-proxy/0.log" Sep 17 17:38:31.599693 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:31.599615 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mbvzt_34e63e2f-5e8b-410b-9df5-65e8686cd545/dns-node-resolver/0.log" Sep 17 17:38:31.658846 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:31.658816 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-dtl88" event={"ID":"b702e320-39d6-43cd-aecb-3fdac70f15fb","Type":"ContainerStarted","Data":"2e59eb32ce66fb06131df5eb60680f45977dd3454802e8dddd358f1d0e78aa72"} Sep 17 17:38:46.628552 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.628508 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59b84b54b9-fc4j9" podUID="2086e9f6-3df4-4f72-b29a-3a19d7c31cad" containerName="console" containerID="cri-o://622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3" gracePeriod=15 Sep 17 17:38:46.925612 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.925578 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:38:46.991048 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.991012 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-oauth-serving-cert\") pod \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " Sep 17 17:38:46.991244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.991058 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-oauth-config\") pod \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " Sep 17 17:38:46.991244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.991100 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-config\") pod \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " Sep 17 17:38:46.991244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.991138 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62vj9\" (UniqueName: \"kubernetes.io/projected/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-kube-api-access-62vj9\") pod \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " Sep 17 17:38:46.991244 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.991217 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-serving-cert\") pod \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " Sep 17 17:38:46.991456 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.991278 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-service-ca\") pod \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\" (UID: \"2086e9f6-3df4-4f72-b29a-3a19d7c31cad\") " Sep 17 17:38:46.991641 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.991615 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-config" (OuterVolumeSpecName: "console-config") pod "2086e9f6-3df4-4f72-b29a-3a19d7c31cad" (UID: "2086e9f6-3df4-4f72-b29a-3a19d7c31cad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:46.991752 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.991718 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2086e9f6-3df4-4f72-b29a-3a19d7c31cad" (UID: "2086e9f6-3df4-4f72-b29a-3a19d7c31cad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:46.991833 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.991806 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-service-ca" (OuterVolumeSpecName: "service-ca") pod "2086e9f6-3df4-4f72-b29a-3a19d7c31cad" (UID: "2086e9f6-3df4-4f72-b29a-3a19d7c31cad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:46.993422 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.993400 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-kube-api-access-62vj9" (OuterVolumeSpecName: "kube-api-access-62vj9") pod "2086e9f6-3df4-4f72-b29a-3a19d7c31cad" (UID: "2086e9f6-3df4-4f72-b29a-3a19d7c31cad"). InnerVolumeSpecName "kube-api-access-62vj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:38:46.993712 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.993693 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2086e9f6-3df4-4f72-b29a-3a19d7c31cad" (UID: "2086e9f6-3df4-4f72-b29a-3a19d7c31cad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:46.993778 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:46.993710 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2086e9f6-3df4-4f72-b29a-3a19d7c31cad" (UID: "2086e9f6-3df4-4f72-b29a-3a19d7c31cad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:47.092214 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.092174 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:38:47.092214 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.092205 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62vj9\" (UniqueName: \"kubernetes.io/projected/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-kube-api-access-62vj9\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:38:47.092214 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.092219 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-serving-cert\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:38:47.092214 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.092227 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-service-ca\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:38:47.092496 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.092236 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-oauth-serving-cert\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:38:47.092496 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.092244 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2086e9f6-3df4-4f72-b29a-3a19d7c31cad-console-oauth-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:38:47.722029 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.721997 2562 generic.go:356] "Generic (PLEG): container finished" podID="2086e9f6-3df4-4f72-b29a-3a19d7c31cad" containerID="622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3" exitCode=0 Sep 17 17:38:47.722459 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.722050 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b84b54b9-fc4j9" Sep 17 17:38:47.722459 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.722061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b84b54b9-fc4j9" event={"ID":"2086e9f6-3df4-4f72-b29a-3a19d7c31cad","Type":"ContainerDied","Data":"622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3"} Sep 17 17:38:47.722459 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.722126 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b84b54b9-fc4j9" event={"ID":"2086e9f6-3df4-4f72-b29a-3a19d7c31cad","Type":"ContainerDied","Data":"d95c6b6f57c3ee9c7877821d390f782cdc753f7854130f2ad8f2eb35371e0c73"} Sep 17 17:38:47.722459 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.722144 2562 scope.go:117] "RemoveContainer" containerID="622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3" Sep 17 17:38:47.730344 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.730329 2562 scope.go:117] "RemoveContainer" containerID="622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3" Sep 17 17:38:47.730614 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:38:47.730585 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3\": container with ID starting with 622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3 not found: ID does not exist" containerID="622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3" Sep 17 17:38:47.730731 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.730622 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3"} err="failed to get container status \"622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3\": rpc error: code = NotFound desc = could not find container \"622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3\": container with ID starting with 622e6d2ada4b1923043920f1eb7493725077cd33e3ff6101f356491ee965a2e3 not found: ID does not exist" Sep 17 17:38:47.743558 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.743530 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b84b54b9-fc4j9"] Sep 17 17:38:47.745293 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.745270 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59b84b54b9-fc4j9"] Sep 17 17:38:47.752594 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:47.752574 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2086e9f6-3df4-4f72-b29a-3a19d7c31cad" path="/var/lib/kubelet/pods/2086e9f6-3df4-4f72-b29a-3a19d7c31cad/volumes" Sep 17 17:38:56.568243 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:56.568137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:38:56.570531 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:56.570505 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b7c7317-0809-4f38-8acb-709a2f66913f-metrics-certs\") pod \"network-metrics-daemon-6ntvh\" (UID: \"9b7c7317-0809-4f38-8acb-709a2f66913f\") " pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:38:56.751538 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:56.751507 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g24m8\"" Sep 17 17:38:56.759594 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:56.759570 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ntvh" Sep 17 17:38:57.026829 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:57.026809 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6ntvh"] Sep 17 17:38:57.029412 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:38:57.029382 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7c7317_0809_4f38_8acb_709a2f66913f.slice/crio-d1710a4e2d524b31ad4be88ad0dc411ce03d78cb88f7e287faadb41baaac58a2 WatchSource:0}: Error finding container d1710a4e2d524b31ad4be88ad0dc411ce03d78cb88f7e287faadb41baaac58a2: Status 404 returned error can't find the container with id d1710a4e2d524b31ad4be88ad0dc411ce03d78cb88f7e287faadb41baaac58a2 Sep 17 17:38:57.763294 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:57.763261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ntvh" event={"ID":"9b7c7317-0809-4f38-8acb-709a2f66913f","Type":"ContainerStarted","Data":"d1710a4e2d524b31ad4be88ad0dc411ce03d78cb88f7e287faadb41baaac58a2"} Sep 17 17:38:58.769493 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:58.769441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ntvh" event={"ID":"9b7c7317-0809-4f38-8acb-709a2f66913f","Type":"ContainerStarted","Data":"ae7fe72a2dfc212b0ca981cfb2e48c87c37646f1041f2334e86b75dfb025b667"} Sep 17 17:38:58.769843 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:58.769531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ntvh" event={"ID":"9b7c7317-0809-4f38-8acb-709a2f66913f","Type":"ContainerStarted","Data":"4f383f1ced0035b6e991defcdcdac18a4406d0c3287c6d8bff7295b9cea972fe"} Sep 17 17:38:58.793067 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:38:58.793017 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6ntvh" podStartSLOduration=253.788885842 podStartE2EDuration="4m14.793002647s" totalImagesPullingTime="1.004116805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:58.792616052 +0000 UTC m=+257.242502183" watchObservedRunningTime="2026-09-17 17:38:58.793002647 +0000 UTC m=+257.242888776" Sep 17 17:39:01.232600 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.232562 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:39:01.233021 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.232848 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="alertmanager" containerID="cri-o://4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c" gracePeriod=120 Sep 17 17:39:01.233021 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.232930 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy-web" containerID="cri-o://252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62" gracePeriod=120 Sep 17 17:39:01.233021 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.232931 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="prom-label-proxy" containerID="cri-o://668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f" gracePeriod=120 Sep 17 17:39:01.233021 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.233011 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy-metric" containerID="cri-o://547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5" gracePeriod=120 Sep 17 17:39:01.233217 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.233008 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="config-reloader" containerID="cri-o://c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d" gracePeriod=120 Sep 17 17:39:01.233217 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.232989 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy" containerID="cri-o://43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0" gracePeriod=120 Sep 17 17:39:01.783859 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.783828 2562 generic.go:356] "Generic (PLEG): container finished" podID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerID="668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f" exitCode=0 Sep 17 17:39:01.783859 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.783851 2562 generic.go:356] "Generic (PLEG): container finished" podID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerID="43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0" exitCode=0 Sep 17 17:39:01.783859 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.783859 2562 generic.go:356] "Generic (PLEG): container finished" podID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerID="c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d" exitCode=0 Sep 17 17:39:01.783859 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.783866 2562 generic.go:356] "Generic (PLEG): container finished" podID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerID="4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c" exitCode=0 Sep 17 17:39:01.784180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.783899 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerDied","Data":"668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f"} Sep 17 17:39:01.784180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.783958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerDied","Data":"43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0"} Sep 17 17:39:01.784180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.783986 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerDied","Data":"c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d"} Sep 17 17:39:01.784180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:01.784010 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerDied","Data":"4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c"} Sep 17 17:39:02.471930 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.471901 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.520084 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520043 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-trusted-ca-bundle\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520084 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520077 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4bmw\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-kube-api-access-p4bmw\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520332 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520099 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-web\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520332 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520117 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-metrics-client-ca\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520332 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520206 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-web-config\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520332 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520262 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-main-tls\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520332 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520300 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-cluster-tls-config\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520624 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520341 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520624 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520373 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-out\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520624 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520413 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-main-db\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520624 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520466 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520624 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520516 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-volume\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520624 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520548 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-tls-assets\") pod \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\" (UID: \"e3d9f59f-465c-463f-bf83-f842efb2eb4b\") " Sep 17 17:39:02.520624 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520561 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:39:02.520972 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520803 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.520972 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.520867 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:39:02.522832 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.522567 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:39:02.524915 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.524878 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:39:02.525104 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.525062 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:39:02.525877 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.525843 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-volume" (OuterVolumeSpecName: "config-volume") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:39:02.526337 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.526301 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-out" (OuterVolumeSpecName: "config-out") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:39:02.526646 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.526615 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:39:02.526775 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.526746 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-kube-api-access-p4bmw" (OuterVolumeSpecName: "kube-api-access-p4bmw") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "kube-api-access-p4bmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:39:02.527051 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.527015 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:39:02.527137 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.527109 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:39:02.530827 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.530799 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:39:02.536676 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.536650 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-web-config" (OuterVolumeSpecName: "web-config") pod "e3d9f59f-465c-463f-bf83-f842efb2eb4b" (UID: "e3d9f59f-465c-463f-bf83-f842efb2eb4b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:39:02.621180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621093 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-web-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621125 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-main-tls\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621135 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-cluster-tls-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621145 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621154 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-out\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621161 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3d9f59f-465c-463f-bf83-f842efb2eb4b-alertmanager-main-db\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621170 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621180 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-config-volume\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621188 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-tls-assets\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621622 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621195 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4bmw\" (UniqueName: \"kubernetes.io/projected/e3d9f59f-465c-463f-bf83-f842efb2eb4b-kube-api-access-p4bmw\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621622 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621205 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3d9f59f-465c-463f-bf83-f842efb2eb4b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.621622 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.621213 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3d9f59f-465c-463f-bf83-f842efb2eb4b-metrics-client-ca\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:02.790972 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.790938 2562 generic.go:356] "Generic (PLEG): container finished" podID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerID="547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5" exitCode=0 Sep 17 17:39:02.790972 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.790967 2562 generic.go:356] "Generic (PLEG): container finished" podID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerID="252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62" exitCode=0 Sep 17 17:39:02.791178 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.791015 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.791178 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.791015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerDied","Data":"547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5"} Sep 17 17:39:02.791178 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.791099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerDied","Data":"252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62"} Sep 17 17:39:02.791178 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.791141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3d9f59f-465c-463f-bf83-f842efb2eb4b","Type":"ContainerDied","Data":"9ebc2839211b864b328f8e34c5e7ea2fe8ff84af8bb3d154a077213081525c1e"} Sep 17 17:39:02.791178 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.791173 2562 scope.go:117] "RemoveContainer" containerID="668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f" Sep 17 17:39:02.803600 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.803566 2562 scope.go:117] "RemoveContainer" containerID="547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5" Sep 17 17:39:02.811167 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.811145 2562 scope.go:117] "RemoveContainer" containerID="43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0" Sep 17 17:39:02.818102 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.818083 2562 scope.go:117] "RemoveContainer" containerID="252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62" Sep 17 17:39:02.823401 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.823350 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:39:02.828185 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.828159 2562 scope.go:117] "RemoveContainer" containerID="c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d" Sep 17 17:39:02.835261 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.835235 2562 scope.go:117] "RemoveContainer" containerID="4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c" Sep 17 17:39:02.839341 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.839314 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:39:02.843026 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.843009 2562 scope.go:117] "RemoveContainer" containerID="e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3" Sep 17 17:39:02.850083 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.850058 2562 scope.go:117] "RemoveContainer" containerID="668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f" Sep 17 17:39:02.850373 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:39:02.850354 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f\": container with ID starting with 668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f not found: ID does not exist" containerID="668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f" Sep 17 17:39:02.850433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.850382 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f"} err="failed to get container status \"668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f\": rpc error: code = NotFound desc = could not find container \"668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f\": container with ID starting with 668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f not found: ID does not exist" Sep 17 17:39:02.850433 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.850402 2562 scope.go:117] "RemoveContainer" containerID="547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5" Sep 17 17:39:02.850638 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:39:02.850621 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5\": container with ID starting with 547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5 not found: ID does not exist" containerID="547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5" Sep 17 17:39:02.850694 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.850644 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5"} err="failed to get container status \"547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5\": rpc error: code = NotFound desc = could not find container \"547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5\": container with ID starting with 547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5 not found: ID does not exist" Sep 17 17:39:02.850694 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.850660 2562 scope.go:117] "RemoveContainer" containerID="43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0" Sep 17 17:39:02.850931 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:39:02.850916 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0\": container with ID starting with 43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0 not found: ID does not exist" containerID="43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0" Sep 17 17:39:02.850974 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.850933 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0"} err="failed to get container status \"43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0\": rpc error: code = NotFound desc = could not find container \"43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0\": container with ID starting with 43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0 not found: ID does not exist" Sep 17 17:39:02.850974 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.850944 2562 scope.go:117] "RemoveContainer" containerID="252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62" Sep 17 17:39:02.851130 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:39:02.851117 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62\": container with ID starting with 252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62 not found: ID does not exist" containerID="252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62" Sep 17 17:39:02.851170 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.851131 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62"} err="failed to get container status \"252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62\": rpc error: code = NotFound desc = could not find container \"252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62\": container with ID starting with 252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62 not found: ID does not exist" Sep 17 17:39:02.851170 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.851141 2562 scope.go:117] "RemoveContainer" containerID="c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d" Sep 17 17:39:02.851360 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:39:02.851343 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d\": container with ID starting with c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d not found: ID does not exist" containerID="c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d" Sep 17 17:39:02.851424 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.851370 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d"} err="failed to get container status \"c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d\": rpc error: code = NotFound desc = could not find container \"c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d\": container with ID starting with c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d not found: ID does not exist" Sep 17 17:39:02.851424 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.851392 2562 scope.go:117] "RemoveContainer" containerID="4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c" Sep 17 17:39:02.851696 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:39:02.851681 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c\": container with ID starting with 4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c not found: ID does not exist" containerID="4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c" Sep 17 17:39:02.851760 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.851699 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c"} err="failed to get container status \"4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c\": rpc error: code = NotFound desc = could not find container \"4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c\": container with ID starting with 4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c not found: ID does not exist" Sep 17 17:39:02.851760 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.851710 2562 scope.go:117] "RemoveContainer" containerID="e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3" Sep 17 17:39:02.851948 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:39:02.851932 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3\": container with ID starting with e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3 not found: ID does not exist" containerID="e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3" Sep 17 17:39:02.851986 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.851951 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3"} err="failed to get container status \"e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3\": rpc error: code = NotFound desc = could not find container \"e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3\": container with ID starting with e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3 not found: ID does not exist" Sep 17 17:39:02.851986 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.851963 2562 scope.go:117] "RemoveContainer" containerID="668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f" Sep 17 17:39:02.852174 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.852155 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f"} err="failed to get container status \"668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f\": rpc error: code = NotFound desc = could not find container \"668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f\": container with ID starting with 668bdf3c30a563640adfbe8a8ae14104fa1caefb012dfd51d15589918864be6f not found: ID does not exist" Sep 17 17:39:02.852246 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.852177 2562 scope.go:117] "RemoveContainer" containerID="547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5" Sep 17 17:39:02.852403 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.852386 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5"} err="failed to get container status \"547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5\": rpc error: code = NotFound desc = could not find container \"547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5\": container with ID starting with 547db035e8e6eabcf4dc249e3bacf3ec32b5de49ff5622d1f64d776a484e61b5 not found: ID does not exist" Sep 17 17:39:02.852446 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.852404 2562 scope.go:117] "RemoveContainer" containerID="43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0" Sep 17 17:39:02.852640 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.852623 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0"} err="failed to get container status \"43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0\": rpc error: code = NotFound desc = could not find container \"43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0\": container with ID starting with 43d1654a73cb5101758a0ef91d5dcb04416427467b07be18f438de07799d85a0 not found: ID does not exist" Sep 17 17:39:02.852711 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.852642 2562 scope.go:117] "RemoveContainer" containerID="252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62" Sep 17 17:39:02.852872 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.852856 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62"} err="failed to get container status \"252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62\": rpc error: code = NotFound desc = could not find container \"252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62\": container with ID starting with 252119b57ed35f963edf046fda4a0bcf56d3832b2246d1b284821222317aec62 not found: ID does not exist" Sep 17 17:39:02.852973 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.852873 2562 scope.go:117] "RemoveContainer" containerID="c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d" Sep 17 17:39:02.853084 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.853067 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d"} err="failed to get container status \"c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d\": rpc error: code = NotFound desc = could not find container \"c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d\": container with ID starting with c8299a63fe4cf6f97c46acc51af65e35ff58addd958295956bfd1f9c228a591d not found: ID does not exist" Sep 17 17:39:02.853149 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.853086 2562 scope.go:117] "RemoveContainer" containerID="4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c" Sep 17 17:39:02.853353 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.853337 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c"} err="failed to get container status \"4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c\": rpc error: code = NotFound desc = could not find container \"4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c\": container with ID starting with 4e2b47153b03ebc462f556e2dacbf017b0164cfd04e2e7a13b52b7a11749ac1c not found: ID does not exist" Sep 17 17:39:02.853415 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.853354 2562 scope.go:117] "RemoveContainer" containerID="e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3" Sep 17 17:39:02.853580 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.853562 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3"} err="failed to get container status \"e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3\": rpc error: code = NotFound desc = could not find container \"e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3\": container with ID starting with e28012203b85f204661f771f3983d1c7c5d79238e75cad3f0b57fc70a48667f3 not found: ID does not exist" Sep 17 17:39:02.871112 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871078 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:39:02.871424 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871387 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="init-config-reloader" Sep 17 17:39:02.871424 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871402 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="init-config-reloader" Sep 17 17:39:02.871424 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871418 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2086e9f6-3df4-4f72-b29a-3a19d7c31cad" containerName="console" Sep 17 17:39:02.871424 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871424 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2086e9f6-3df4-4f72-b29a-3a19d7c31cad" containerName="console" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871433 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy-web" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871440 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy-web" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871446 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy-metric" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871464 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy-metric" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871494 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="config-reloader" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871502 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="config-reloader" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871509 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="prom-label-proxy" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871514 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="prom-label-proxy" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871524 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871529 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871536 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="alertmanager" Sep 17 17:39:02.871574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871541 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="alertmanager" Sep 17 17:39:02.871939 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871588 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2086e9f6-3df4-4f72-b29a-3a19d7c31cad" containerName="console" Sep 17 17:39:02.871939 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871596 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="alertmanager" Sep 17 17:39:02.871939 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871603 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="config-reloader" Sep 17 17:39:02.871939 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871609 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy" Sep 17 17:39:02.871939 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871614 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy-web" Sep 17 17:39:02.871939 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871619 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="prom-label-proxy" Sep 17 17:39:02.871939 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.871624 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" containerName="kube-rbac-proxy-metric" Sep 17 17:39:02.874842 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.874827 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.877204 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.877182 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hjrvd\"" Sep 17 17:39:02.877330 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.877184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 17:39:02.877330 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.877184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 17:39:02.877330 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.877308 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 17:39:02.877583 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.877496 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 17:39:02.877583 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.877497 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 17:39:02.877583 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.877524 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 17:39:02.877583 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.877528 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 17:39:02.877827 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.877606 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 17:39:02.882781 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.882760 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 17:39:02.903911 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.903879 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:39:02.923570 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.923715 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923577 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-web-config\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.923715 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.923715 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.923836 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.923836 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtsmn\" (UniqueName: \"kubernetes.io/projected/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-kube-api-access-qtsmn\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.923836 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.923836 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.923836 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923806 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.923836 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.924030 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.924030 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:02.924030 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:02.923880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-config-out\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025005 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.024963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-web-config\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025194 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025194 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025194 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025194 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtsmn\" (UniqueName: \"kubernetes.io/projected/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-kube-api-access-qtsmn\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025194 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025108 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025460 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025460 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025460 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025660 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025660 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025660 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025594 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-config-out\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025660 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025602 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.025660 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.025654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.026518 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.026035 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.026518 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.026156 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.028421 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.028119 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-config-out\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.028421 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.028349 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.028592 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.028519 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.028632 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.028595 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.028699 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.028642 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-web-config\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.028755 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.028732 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.028911 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.028897 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.029158 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.029142 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.029572 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.029553 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.034611 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.034594 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtsmn\" (UniqueName: \"kubernetes.io/projected/4b6d5700-8a05-4a05-933f-b9d1fdae45fb-kube-api-access-qtsmn\") pod \"alertmanager-main-0\" (UID: \"4b6d5700-8a05-4a05-933f-b9d1fdae45fb\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.185177 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.185097 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:39:03.469843 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.469820 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:39:03.471382 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:39:03.471359 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6d5700_8a05_4a05_933f_b9d1fdae45fb.slice/crio-9a9dd1044727cf078eeaaa15d013d573359fa5fba77f352aa8db8acc0f8ea28c WatchSource:0}: Error finding container 9a9dd1044727cf078eeaaa15d013d573359fa5fba77f352aa8db8acc0f8ea28c: Status 404 returned error can't find the container with id 9a9dd1044727cf078eeaaa15d013d573359fa5fba77f352aa8db8acc0f8ea28c Sep 17 17:39:03.754404 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.754365 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3d9f59f-465c-463f-bf83-f842efb2eb4b" path="/var/lib/kubelet/pods/e3d9f59f-465c-463f-bf83-f842efb2eb4b/volumes" Sep 17 17:39:03.797243 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.797212 2562 generic.go:356] "Generic (PLEG): container finished" podID="4b6d5700-8a05-4a05-933f-b9d1fdae45fb" containerID="6275d58b671315eccbd50a9ffb1bd4b3cd07125e6675d848e73b4246f27f1f2c" exitCode=0 Sep 17 17:39:03.797412 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.797278 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b6d5700-8a05-4a05-933f-b9d1fdae45fb","Type":"ContainerDied","Data":"6275d58b671315eccbd50a9ffb1bd4b3cd07125e6675d848e73b4246f27f1f2c"} Sep 17 17:39:03.797412 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:03.797325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b6d5700-8a05-4a05-933f-b9d1fdae45fb","Type":"ContainerStarted","Data":"9a9dd1044727cf078eeaaa15d013d573359fa5fba77f352aa8db8acc0f8ea28c"} Sep 17 17:39:04.804532 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:04.804497 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b6d5700-8a05-4a05-933f-b9d1fdae45fb","Type":"ContainerStarted","Data":"3f724bf939a673a5dd21a80f04f7aa1b683de5305e8aa91c3cf647d344475cda"} Sep 17 17:39:04.804929 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:04.804585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b6d5700-8a05-4a05-933f-b9d1fdae45fb","Type":"ContainerStarted","Data":"d90756ff273b09f538830f2d0ffa3a7183dd31d2ab965ddcf679bbe774b227f5"} Sep 17 17:39:04.804929 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:04.804614 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b6d5700-8a05-4a05-933f-b9d1fdae45fb","Type":"ContainerStarted","Data":"bdbc2098e735d33da5916984cd9a25e9722c47698d1ab61ce1b01795eccf08da"} Sep 17 17:39:04.804929 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:04.804638 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b6d5700-8a05-4a05-933f-b9d1fdae45fb","Type":"ContainerStarted","Data":"bbb14e75696365ee3fb3f6ccdea61850e1efb373a10a35fc7077dfcbd9bf92de"} Sep 17 17:39:04.804929 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:04.804661 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b6d5700-8a05-4a05-933f-b9d1fdae45fb","Type":"ContainerStarted","Data":"22ddc01ef41335eeff2308f1be73d5d927c8769883f3971a37634dd35e6c35a3"} Sep 17 17:39:04.804929 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:04.804682 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4b6d5700-8a05-4a05-933f-b9d1fdae45fb","Type":"ContainerStarted","Data":"79fb16c0272651400fdb213d2cd0df93a146775a10652ddf050bd46d7de81462"} Sep 17 17:39:04.836633 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:04.836582 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.81779225 podStartE2EDuration="2.836565758s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.773508ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:39:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:39:04.83426804 +0000 UTC m=+263.284154170" watchObservedRunningTime="2026-09-17 17:39:04.836565758 +0000 UTC m=+263.286451887" Sep 17 17:39:05.306002 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.305969 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fd47997c6-hwtf7"] Sep 17 17:39:05.308229 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.308212 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.311401 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.311376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 17 17:39:05.311401 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.311380 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 17 17:39:05.311624 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.311501 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 17 17:39:05.311624 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.311530 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 17 17:39:05.311744 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.311731 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 17 17:39:05.312218 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.312199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hndfd\"" Sep 17 17:39:05.318268 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.318249 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 17 17:39:05.370812 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.370775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fd47997c6-hwtf7"] Sep 17 17:39:05.448003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.447961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-secret-telemeter-client\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.448003 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.448004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.448233 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.448078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8377fbda-32a0-4d03-9bda-9887d5327f29-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.448233 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.448145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-telemeter-client-tls\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.448233 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.448186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8377fbda-32a0-4d03-9bda-9887d5327f29-metrics-client-ca\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.448233 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.448215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf5rw\" (UniqueName: \"kubernetes.io/projected/8377fbda-32a0-4d03-9bda-9887d5327f29-kube-api-access-wf5rw\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.448382 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.448243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-federate-client-tls\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.448382 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.448277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8377fbda-32a0-4d03-9bda-9887d5327f29-serving-certs-ca-bundle\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.548741 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.548704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8377fbda-32a0-4d03-9bda-9887d5327f29-metrics-client-ca\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.548907 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.548748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf5rw\" (UniqueName: \"kubernetes.io/projected/8377fbda-32a0-4d03-9bda-9887d5327f29-kube-api-access-wf5rw\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.548966 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.548939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-federate-client-tls\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.549041 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.548975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8377fbda-32a0-4d03-9bda-9887d5327f29-serving-certs-ca-bundle\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.549041 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.549021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-secret-telemeter-client\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.549207 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.549050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.549207 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.549106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8377fbda-32a0-4d03-9bda-9887d5327f29-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.549207 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.549143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-telemeter-client-tls\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.549639 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.549604 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8377fbda-32a0-4d03-9bda-9887d5327f29-metrics-client-ca\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.549867 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.549842 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8377fbda-32a0-4d03-9bda-9887d5327f29-serving-certs-ca-bundle\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.549982 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.549956 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8377fbda-32a0-4d03-9bda-9887d5327f29-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.551574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.551542 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-federate-client-tls\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.551815 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.551764 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-secret-telemeter-client\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.552089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.552067 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-telemeter-client-tls\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.552177 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.552088 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8377fbda-32a0-4d03-9bda-9887d5327f29-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.559302 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.559239 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf5rw\" (UniqueName: \"kubernetes.io/projected/8377fbda-32a0-4d03-9bda-9887d5327f29-kube-api-access-wf5rw\") pod \"telemeter-client-5fd47997c6-hwtf7\" (UID: \"8377fbda-32a0-4d03-9bda-9887d5327f29\") " pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.618273 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.618243 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" Sep 17 17:39:05.897930 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:05.897850 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fd47997c6-hwtf7"] Sep 17 17:39:05.901183 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:39:05.901155 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8377fbda_32a0_4d03_9bda_9887d5327f29.slice/crio-38bdc4ff3046d372906df6e39f66fadba5fa7f3cbe1b62ca17d850a7693997a5 WatchSource:0}: Error finding container 38bdc4ff3046d372906df6e39f66fadba5fa7f3cbe1b62ca17d850a7693997a5: Status 404 returned error can't find the container with id 38bdc4ff3046d372906df6e39f66fadba5fa7f3cbe1b62ca17d850a7693997a5 Sep 17 17:39:06.815524 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:06.815465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" event={"ID":"8377fbda-32a0-4d03-9bda-9887d5327f29","Type":"ContainerStarted","Data":"38bdc4ff3046d372906df6e39f66fadba5fa7f3cbe1b62ca17d850a7693997a5"} Sep 17 17:39:08.826574 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:08.826540 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" event={"ID":"8377fbda-32a0-4d03-9bda-9887d5327f29","Type":"ContainerStarted","Data":"13f5bd94a39af08ddbe8deca9fd7f757175ca3b08e86bc047dbbd509bb3bf5fa"} Sep 17 17:39:08.826993 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:08.826599 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" event={"ID":"8377fbda-32a0-4d03-9bda-9887d5327f29","Type":"ContainerStarted","Data":"605e51a30b0b569e38f9295295043b2681cfad6b0a9e3987f47d1d3d0c246abb"} Sep 17 17:39:08.826993 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:08.826618 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" event={"ID":"8377fbda-32a0-4d03-9bda-9887d5327f29","Type":"ContainerStarted","Data":"5d312598304c789fea09176c217eff7f56181ed4ee54d898eef0f084603f0fe6"} Sep 17 17:39:08.857271 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:08.857222 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fd47997c6-hwtf7" podStartSLOduration=1.927619751 podStartE2EDuration="3.857207844s" totalImagesPullingTime="1.929588093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:39:08.855924448 +0000 UTC m=+267.305810578" watchObservedRunningTime="2026-09-17 17:39:08.857207844 +0000 UTC m=+267.307093973" Sep 17 17:39:08.952132 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:08.952100 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fcf48f8d6-zjghr"] Sep 17 17:39:08.954277 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:08.954257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:08.968083 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:08.968062 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fcf48f8d6-zjghr"] Sep 17 17:39:09.079049 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.078951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btskh\" (UniqueName: \"kubernetes.io/projected/2c091c51-3282-4f44-a332-786bbaf1f17a-kube-api-access-btskh\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.079049 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.078987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-console-config\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.079049 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.079012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-trusted-ca-bundle\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.079328 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.079071 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-oauth-config\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.079328 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.079124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-serving-cert\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.079328 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.079193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-oauth-serving-cert\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.079328 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.079254 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-service-ca\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.180462 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.180409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-oauth-serving-cert\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.180628 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.180506 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-service-ca\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.180628 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.180537 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btskh\" (UniqueName: \"kubernetes.io/projected/2c091c51-3282-4f44-a332-786bbaf1f17a-kube-api-access-btskh\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.180628 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.180553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-console-config\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.180628 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.180574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-trusted-ca-bundle\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.180628 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.180593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-oauth-config\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.180628 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.180624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-serving-cert\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.181249 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.181225 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-oauth-serving-cert\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.181358 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.181259 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-console-config\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.181358 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.181289 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-service-ca\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.181682 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.181655 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-trusted-ca-bundle\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.183081 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.183062 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-serving-cert\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.183291 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.183270 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-oauth-config\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.189950 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.189930 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btskh\" (UniqueName: \"kubernetes.io/projected/2c091c51-3282-4f44-a332-786bbaf1f17a-kube-api-access-btskh\") pod \"console-fcf48f8d6-zjghr\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.262992 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.262950 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:09.538344 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.538174 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fcf48f8d6-zjghr"] Sep 17 17:39:09.541050 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:39:09.541027 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c091c51_3282_4f44_a332_786bbaf1f17a.slice/crio-960930b2d8191b96de84d7265c37b8c30b5411cf7b9239a7957a2d8dd7540dfa WatchSource:0}: Error finding container 960930b2d8191b96de84d7265c37b8c30b5411cf7b9239a7957a2d8dd7540dfa: Status 404 returned error can't find the container with id 960930b2d8191b96de84d7265c37b8c30b5411cf7b9239a7957a2d8dd7540dfa Sep 17 17:39:09.832406 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.832318 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf48f8d6-zjghr" event={"ID":"2c091c51-3282-4f44-a332-786bbaf1f17a","Type":"ContainerStarted","Data":"8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86"} Sep 17 17:39:09.832406 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.832380 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf48f8d6-zjghr" event={"ID":"2c091c51-3282-4f44-a332-786bbaf1f17a","Type":"ContainerStarted","Data":"960930b2d8191b96de84d7265c37b8c30b5411cf7b9239a7957a2d8dd7540dfa"} Sep 17 17:39:09.854131 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:09.854051 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fcf48f8d6-zjghr" podStartSLOduration=1.854034128 podStartE2EDuration="1.854034128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:39:09.853297533 +0000 UTC m=+268.303183664" watchObservedRunningTime="2026-09-17 17:39:09.854034128 +0000 UTC m=+268.303920259" Sep 17 17:39:19.263088 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:19.263049 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:19.263582 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:19.263151 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:19.267984 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:19.267963 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:19.875867 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:19.875834 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:39:19.928617 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:19.928579 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b44b8fc68-vktdb"] Sep 17 17:39:43.617021 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:43.616994 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:39:43.622134 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:43.622115 2562 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 17:39:43.622487 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:43.622454 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:39:44.951431 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:44.951384 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b44b8fc68-vktdb" podUID="b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" containerName="console" containerID="cri-o://3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439" gracePeriod=15 Sep 17 17:39:45.192554 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.192526 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:39:45.286722 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.286693 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-service-ca\") pod \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " Sep 17 17:39:45.286921 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.286738 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-config\") pod \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " Sep 17 17:39:45.286921 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.286789 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-trusted-ca-bundle\") pod \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " Sep 17 17:39:45.286921 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.286805 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m998\" (UniqueName: \"kubernetes.io/projected/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-kube-api-access-6m998\") pod \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " Sep 17 17:39:45.286921 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.286820 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-oauth-serving-cert\") pod \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " Sep 17 17:39:45.286921 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.286853 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-serving-cert\") pod \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " Sep 17 17:39:45.287182 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.286941 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-oauth-config\") pod \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\" (UID: \"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3\") " Sep 17 17:39:45.287241 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.287192 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" (UID: "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:39:45.287241 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.287224 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" (UID: "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:39:45.287346 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.287302 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-config" (OuterVolumeSpecName: "console-config") pod "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" (UID: "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:39:45.287346 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.287311 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" (UID: "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:39:45.289089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.289061 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" (UID: "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:39:45.289089 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.289077 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-kube-api-access-6m998" (OuterVolumeSpecName: "kube-api-access-6m998") pod "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" (UID: "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3"). InnerVolumeSpecName "kube-api-access-6m998". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:39:45.289237 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.289128 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" (UID: "b34bb58d-8c4f-46ae-842b-ef0cb49d08e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:39:45.388447 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.388403 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-trusted-ca-bundle\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:45.388447 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.388437 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m998\" (UniqueName: \"kubernetes.io/projected/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-kube-api-access-6m998\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:45.388447 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.388453 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-oauth-serving-cert\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:45.388704 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.388465 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-serving-cert\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:45.388704 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.388507 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-oauth-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:45.388704 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.388520 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-service-ca\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:45.388704 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.388533 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3-console-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:39:45.974976 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.974934 2562 generic.go:356] "Generic (PLEG): container finished" podID="b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" containerID="3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439" exitCode=0 Sep 17 17:39:45.975353 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.974976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b44b8fc68-vktdb" event={"ID":"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3","Type":"ContainerDied","Data":"3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439"} Sep 17 17:39:45.975353 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.974993 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b44b8fc68-vktdb" Sep 17 17:39:45.975353 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.975030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b44b8fc68-vktdb" event={"ID":"b34bb58d-8c4f-46ae-842b-ef0cb49d08e3","Type":"ContainerDied","Data":"21fd305ecca7670b7a91db79138e2ede719f9d0371018ea663e516de619b8d14"} Sep 17 17:39:45.975353 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.975051 2562 scope.go:117] "RemoveContainer" containerID="3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439" Sep 17 17:39:45.982852 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.982826 2562 scope.go:117] "RemoveContainer" containerID="3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439" Sep 17 17:39:45.983144 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:39:45.983126 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439\": container with ID starting with 3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439 not found: ID does not exist" containerID="3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439" Sep 17 17:39:45.983210 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.983152 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439"} err="failed to get container status \"3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439\": rpc error: code = NotFound desc = could not find container \"3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439\": container with ID starting with 3410f334ca0eb350295e50b7906d89869dafa538430274a8ba1f1ece37157439 not found: ID does not exist" Sep 17 17:39:45.993106 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.993070 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b44b8fc68-vktdb"] Sep 17 17:39:45.997443 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:45.997418 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b44b8fc68-vktdb"] Sep 17 17:39:47.754287 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:39:47.754253 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" path="/var/lib/kubelet/pods/b34bb58d-8c4f-46ae-842b-ef0cb49d08e3/volumes" Sep 17 17:40:44.970693 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:44.970656 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c9c6cc48d-fkd5w"] Sep 17 17:40:44.971104 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:44.970947 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" containerName="console" Sep 17 17:40:44.971104 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:44.970959 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" containerName="console" Sep 17 17:40:44.971104 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:44.971023 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b34bb58d-8c4f-46ae-842b-ef0cb49d08e3" containerName="console" Sep 17 17:40:44.975042 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:44.975027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:44.985965 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:44.985941 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9c6cc48d-fkd5w"] Sep 17 17:40:45.088569 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.088528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-oauth-config\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.088569 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.088568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-824vq\" (UniqueName: \"kubernetes.io/projected/4546df1a-3085-43a8-a78c-716dd15e74f5-kube-api-access-824vq\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.088770 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.088608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-service-ca\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.088770 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.088682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-console-config\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.088770 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.088737 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-trusted-ca-bundle\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.088770 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.088769 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-serving-cert\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.088894 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.088785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-oauth-serving-cert\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.189237 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.189199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-trusted-ca-bundle\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.189237 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.189243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-serving-cert\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.189467 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.189265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-oauth-serving-cert\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.189467 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.189383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-oauth-config\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.189467 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.189417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-824vq\" (UniqueName: \"kubernetes.io/projected/4546df1a-3085-43a8-a78c-716dd15e74f5-kube-api-access-824vq\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.189654 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.189495 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-service-ca\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.189654 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.189533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-console-config\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.190137 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.190110 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-oauth-serving-cert\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.190253 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.190163 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-service-ca\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.190253 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.190174 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-trusted-ca-bundle\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.190253 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.190205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-console-config\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.191866 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.191843 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-oauth-config\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.191965 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.191892 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-serving-cert\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.197901 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.197873 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-824vq\" (UniqueName: \"kubernetes.io/projected/4546df1a-3085-43a8-a78c-716dd15e74f5-kube-api-access-824vq\") pod \"console-c9c6cc48d-fkd5w\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.284113 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.284080 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:45.560354 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:45.560286 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9c6cc48d-fkd5w"] Sep 17 17:40:45.563031 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:40:45.562991 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4546df1a_3085_43a8_a78c_716dd15e74f5.slice/crio-60811addd0ee93d780df333d9f2c4c441bcf41edc85feb7042f020b0b56f6e75 WatchSource:0}: Error finding container 60811addd0ee93d780df333d9f2c4c441bcf41edc85feb7042f020b0b56f6e75: Status 404 returned error can't find the container with id 60811addd0ee93d780df333d9f2c4c441bcf41edc85feb7042f020b0b56f6e75 Sep 17 17:40:46.215542 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:46.215502 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9c6cc48d-fkd5w" event={"ID":"4546df1a-3085-43a8-a78c-716dd15e74f5","Type":"ContainerStarted","Data":"a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f"} Sep 17 17:40:46.215910 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:46.215583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9c6cc48d-fkd5w" event={"ID":"4546df1a-3085-43a8-a78c-716dd15e74f5","Type":"ContainerStarted","Data":"60811addd0ee93d780df333d9f2c4c441bcf41edc85feb7042f020b0b56f6e75"} Sep 17 17:40:46.241203 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:46.241158 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c9c6cc48d-fkd5w" podStartSLOduration=2.241142485 podStartE2EDuration="2.241142485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:40:46.239838547 +0000 UTC m=+364.689724678" watchObservedRunningTime="2026-09-17 17:40:46.241142485 +0000 UTC m=+364.691028614" Sep 17 17:40:55.285122 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:55.285090 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:55.285554 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:55.285163 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:55.289988 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:55.289964 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:56.256767 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:56.256738 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:40:56.328416 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:40:56.328381 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fcf48f8d6-zjghr"] Sep 17 17:41:21.347873 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.347833 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fcf48f8d6-zjghr" podUID="2c091c51-3282-4f44-a332-786bbaf1f17a" containerName="console" containerID="cri-o://8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86" gracePeriod=15 Sep 17 17:41:21.591812 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.591780 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:41:21.601020 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.600991 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-trusted-ca-bundle\") pod \"2c091c51-3282-4f44-a332-786bbaf1f17a\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " Sep 17 17:41:21.601188 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601170 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-serving-cert\") pod \"2c091c51-3282-4f44-a332-786bbaf1f17a\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " Sep 17 17:41:21.601375 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601221 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-console-config\") pod \"2c091c51-3282-4f44-a332-786bbaf1f17a\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " Sep 17 17:41:21.601421 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601408 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-oauth-serving-cert\") pod \"2c091c51-3282-4f44-a332-786bbaf1f17a\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " Sep 17 17:41:21.601498 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601459 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-service-ca\") pod \"2c091c51-3282-4f44-a332-786bbaf1f17a\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " Sep 17 17:41:21.601545 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601515 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-oauth-config\") pod \"2c091c51-3282-4f44-a332-786bbaf1f17a\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " Sep 17 17:41:21.601592 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601546 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btskh\" (UniqueName: \"kubernetes.io/projected/2c091c51-3282-4f44-a332-786bbaf1f17a-kube-api-access-btskh\") pod \"2c091c51-3282-4f44-a332-786bbaf1f17a\" (UID: \"2c091c51-3282-4f44-a332-786bbaf1f17a\") " Sep 17 17:41:21.601933 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601739 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-console-config" (OuterVolumeSpecName: "console-config") pod "2c091c51-3282-4f44-a332-786bbaf1f17a" (UID: "2c091c51-3282-4f44-a332-786bbaf1f17a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:41:21.601933 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601786 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2c091c51-3282-4f44-a332-786bbaf1f17a" (UID: "2c091c51-3282-4f44-a332-786bbaf1f17a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:41:21.601933 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601846 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2c091c51-3282-4f44-a332-786bbaf1f17a" (UID: "2c091c51-3282-4f44-a332-786bbaf1f17a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:41:21.602097 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.601952 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-service-ca" (OuterVolumeSpecName: "service-ca") pod "2c091c51-3282-4f44-a332-786bbaf1f17a" (UID: "2c091c51-3282-4f44-a332-786bbaf1f17a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:41:21.603602 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.603576 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2c091c51-3282-4f44-a332-786bbaf1f17a" (UID: "2c091c51-3282-4f44-a332-786bbaf1f17a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:41:21.603685 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.603599 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c091c51-3282-4f44-a332-786bbaf1f17a-kube-api-access-btskh" (OuterVolumeSpecName: "kube-api-access-btskh") pod "2c091c51-3282-4f44-a332-786bbaf1f17a" (UID: "2c091c51-3282-4f44-a332-786bbaf1f17a"). InnerVolumeSpecName "kube-api-access-btskh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:41:21.603880 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.603850 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2c091c51-3282-4f44-a332-786bbaf1f17a" (UID: "2c091c51-3282-4f44-a332-786bbaf1f17a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:41:21.702782 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.702751 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-trusted-ca-bundle\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:41:21.702782 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.702778 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-serving-cert\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:41:21.702782 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.702788 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-console-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:41:21.703007 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.702797 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-oauth-serving-cert\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:41:21.703007 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.702806 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c091c51-3282-4f44-a332-786bbaf1f17a-service-ca\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:41:21.703007 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.702814 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c091c51-3282-4f44-a332-786bbaf1f17a-console-oauth-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:41:21.703007 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:21.702821 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btskh\" (UniqueName: \"kubernetes.io/projected/2c091c51-3282-4f44-a332-786bbaf1f17a-kube-api-access-btskh\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:41:22.357808 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:22.357771 2562 generic.go:356] "Generic (PLEG): container finished" podID="2c091c51-3282-4f44-a332-786bbaf1f17a" containerID="8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86" exitCode=0 Sep 17 17:41:22.358291 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:22.357840 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf48f8d6-zjghr" Sep 17 17:41:22.358291 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:22.357856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf48f8d6-zjghr" event={"ID":"2c091c51-3282-4f44-a332-786bbaf1f17a","Type":"ContainerDied","Data":"8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86"} Sep 17 17:41:22.358291 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:22.357908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf48f8d6-zjghr" event={"ID":"2c091c51-3282-4f44-a332-786bbaf1f17a","Type":"ContainerDied","Data":"960930b2d8191b96de84d7265c37b8c30b5411cf7b9239a7957a2d8dd7540dfa"} Sep 17 17:41:22.358291 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:22.357928 2562 scope.go:117] "RemoveContainer" containerID="8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86" Sep 17 17:41:22.366710 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:22.366681 2562 scope.go:117] "RemoveContainer" containerID="8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86" Sep 17 17:41:22.366999 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:41:22.366980 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86\": container with ID starting with 8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86 not found: ID does not exist" containerID="8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86" Sep 17 17:41:22.367042 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:22.367007 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86"} err="failed to get container status \"8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86\": rpc error: code = NotFound desc = could not find container \"8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86\": container with ID starting with 8e3e439941314ab0a5f9bf8f77e9eee6d5f15168f0e1d77e307e0c9607e50a86 not found: ID does not exist" Sep 17 17:41:22.376050 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:22.376027 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fcf48f8d6-zjghr"] Sep 17 17:41:22.381579 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:22.381556 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fcf48f8d6-zjghr"] Sep 17 17:41:23.754680 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:23.754651 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c091c51-3282-4f44-a332-786bbaf1f17a" path="/var/lib/kubelet/pods/2c091c51-3282-4f44-a332-786bbaf1f17a/volumes" Sep 17 17:41:42.068966 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.068933 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42"] Sep 17 17:41:42.069418 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.069270 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c091c51-3282-4f44-a332-786bbaf1f17a" containerName="console" Sep 17 17:41:42.069418 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.069282 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c091c51-3282-4f44-a332-786bbaf1f17a" containerName="console" Sep 17 17:41:42.069418 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.069331 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c091c51-3282-4f44-a332-786bbaf1f17a" containerName="console" Sep 17 17:41:42.072129 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.072114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:41:42.074522 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.074498 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Sep 17 17:41:42.074665 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.074502 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Sep 17 17:41:42.074665 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.074637 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-xwtz2\"" Sep 17 17:41:42.074665 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.074657 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Sep 17 17:41:42.085327 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.085303 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42"] Sep 17 17:41:42.171996 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.171958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ac4481bf-9943-43c3-9c45-653a764a52a1-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-zfq42\" (UID: \"ac4481bf-9943-43c3-9c45-653a764a52a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:41:42.172176 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.172010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwgz\" (UniqueName: \"kubernetes.io/projected/ac4481bf-9943-43c3-9c45-653a764a52a1-kube-api-access-2lwgz\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-zfq42\" (UID: \"ac4481bf-9943-43c3-9c45-653a764a52a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:41:42.273421 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.273383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ac4481bf-9943-43c3-9c45-653a764a52a1-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-zfq42\" (UID: \"ac4481bf-9943-43c3-9c45-653a764a52a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:41:42.273596 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.273432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwgz\" (UniqueName: \"kubernetes.io/projected/ac4481bf-9943-43c3-9c45-653a764a52a1-kube-api-access-2lwgz\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-zfq42\" (UID: \"ac4481bf-9943-43c3-9c45-653a764a52a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:41:42.275724 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.275703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/ac4481bf-9943-43c3-9c45-653a764a52a1-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-zfq42\" (UID: \"ac4481bf-9943-43c3-9c45-653a764a52a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:41:42.283181 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.283160 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwgz\" (UniqueName: \"kubernetes.io/projected/ac4481bf-9943-43c3-9c45-653a764a52a1-kube-api-access-2lwgz\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-zfq42\" (UID: \"ac4481bf-9943-43c3-9c45-653a764a52a1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:41:42.381791 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.381708 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:41:42.666977 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.666901 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42"] Sep 17 17:41:42.669926 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:41:42.669901 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4481bf_9943_43c3_9c45_653a764a52a1.slice/crio-afebf5e3dad28fa99f138f196ff64029a4d787c00b3c961462c79062212f4893 WatchSource:0}: Error finding container afebf5e3dad28fa99f138f196ff64029a4d787c00b3c961462c79062212f4893: Status 404 returned error can't find the container with id afebf5e3dad28fa99f138f196ff64029a4d787c00b3c961462c79062212f4893 Sep 17 17:41:42.671697 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:42.671678 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:41:43.443995 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:43.443958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" event={"ID":"ac4481bf-9943-43c3-9c45-653a764a52a1","Type":"ContainerStarted","Data":"afebf5e3dad28fa99f138f196ff64029a4d787c00b3c961462c79062212f4893"} Sep 17 17:41:47.467714 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:47.467676 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" event={"ID":"ac4481bf-9943-43c3-9c45-653a764a52a1","Type":"ContainerStarted","Data":"7c3c20a5d9c3636143d237e43277637e5eb3bd50194119360cdabdd4c6dd4f01"} Sep 17 17:41:47.468180 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:47.467816 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:41:47.492114 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:47.492064 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" podStartSLOduration=1.5062834349999998 podStartE2EDuration="5.492048909s" totalImagesPullingTime="3.985765474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:47.489882384 +0000 UTC m=+425.939768515" watchObservedRunningTime="2026-09-17 17:41:47.492048909 +0000 UTC m=+425.941935039" Sep 17 17:41:48.153889 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.153858 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-b89zz"] Sep 17 17:41:48.157116 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.157095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:48.159299 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.159278 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Sep 17 17:41:48.159389 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.159313 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Sep 17 17:41:48.159440 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.159391 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-h6dsj\"" Sep 17 17:41:48.170183 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.170164 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-b89zz"] Sep 17 17:41:48.227336 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.227301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thqph\" (UniqueName: \"kubernetes.io/projected/33a63c04-f48f-469b-b6d5-f68892d893b3-kube-api-access-thqph\") pod \"keda-admission-6c4d864b86-b89zz\" (UID: \"33a63c04-f48f-469b-b6d5-f68892d893b3\") " pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:48.227496 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.227343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/33a63c04-f48f-469b-b6d5-f68892d893b3-certificates\") pod \"keda-admission-6c4d864b86-b89zz\" (UID: \"33a63c04-f48f-469b-b6d5-f68892d893b3\") " pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:48.328031 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.328000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqph\" (UniqueName: \"kubernetes.io/projected/33a63c04-f48f-469b-b6d5-f68892d893b3-kube-api-access-thqph\") pod \"keda-admission-6c4d864b86-b89zz\" (UID: \"33a63c04-f48f-469b-b6d5-f68892d893b3\") " pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:48.328195 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.328042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/33a63c04-f48f-469b-b6d5-f68892d893b3-certificates\") pod \"keda-admission-6c4d864b86-b89zz\" (UID: \"33a63c04-f48f-469b-b6d5-f68892d893b3\") " pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:48.328195 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:41:48.328154 2562 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Sep 17 17:41:48.328195 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:41:48.328171 2562 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-6c4d864b86-b89zz: secret "keda-admission-webhooks-certs" not found Sep 17 17:41:48.328295 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:41:48.328236 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33a63c04-f48f-469b-b6d5-f68892d893b3-certificates podName:33a63c04-f48f-469b-b6d5-f68892d893b3 nodeName:}" failed. No retries permitted until 2026-09-17 17:41:48.828217134 +0000 UTC m=+427.278103244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/33a63c04-f48f-469b-b6d5-f68892d893b3-certificates") pod "keda-admission-6c4d864b86-b89zz" (UID: "33a63c04-f48f-469b-b6d5-f68892d893b3") : secret "keda-admission-webhooks-certs" not found Sep 17 17:41:48.344635 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.344609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thqph\" (UniqueName: \"kubernetes.io/projected/33a63c04-f48f-469b-b6d5-f68892d893b3-kube-api-access-thqph\") pod \"keda-admission-6c4d864b86-b89zz\" (UID: \"33a63c04-f48f-469b-b6d5-f68892d893b3\") " pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:48.832900 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.832867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/33a63c04-f48f-469b-b6d5-f68892d893b3-certificates\") pod \"keda-admission-6c4d864b86-b89zz\" (UID: \"33a63c04-f48f-469b-b6d5-f68892d893b3\") " pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:48.835405 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:48.835377 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/33a63c04-f48f-469b-b6d5-f68892d893b3-certificates\") pod \"keda-admission-6c4d864b86-b89zz\" (UID: \"33a63c04-f48f-469b-b6d5-f68892d893b3\") " pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:49.067662 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:49.067624 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:49.349991 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:49.349960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-b89zz"] Sep 17 17:41:49.352786 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:41:49.352757 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a63c04_f48f_469b_b6d5_f68892d893b3.slice/crio-72e7f3560baf73098d70a43a32ec8ad8140370231162b3acc7fa8d71d7683741 WatchSource:0}: Error finding container 72e7f3560baf73098d70a43a32ec8ad8140370231162b3acc7fa8d71d7683741: Status 404 returned error can't find the container with id 72e7f3560baf73098d70a43a32ec8ad8140370231162b3acc7fa8d71d7683741 Sep 17 17:41:49.478398 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:49.478312 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-b89zz" event={"ID":"33a63c04-f48f-469b-b6d5-f68892d893b3","Type":"ContainerStarted","Data":"72e7f3560baf73098d70a43a32ec8ad8140370231162b3acc7fa8d71d7683741"} Sep 17 17:41:51.489352 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:51.489318 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-b89zz" event={"ID":"33a63c04-f48f-469b-b6d5-f68892d893b3","Type":"ContainerStarted","Data":"54646baa7dbadd7a4e2e424c53e475acf755da7eb620aa2f903fe765802317b7"} Sep 17 17:41:51.489771 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:51.489446 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:41:51.512953 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:41:51.512901 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-b89zz" podStartSLOduration=1.985533494 podStartE2EDuration="3.512886278s" totalImagesPullingTime="1.527352784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:41:51.511350596 +0000 UTC m=+429.961236739" watchObservedRunningTime="2026-09-17 17:41:51.512886278 +0000 UTC m=+429.962772468" Sep 17 17:42:08.475426 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:42:08.475340 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-zfq42" Sep 17 17:42:12.495217 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:42:12.495190 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-b89zz" Sep 17 17:43:03.425680 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.425645 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67c4444946-dk59q"] Sep 17 17:43:03.428794 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.428776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.444487 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.444445 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c4444946-dk59q"] Sep 17 17:43:03.465964 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.465942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrrjt\" (UniqueName: \"kubernetes.io/projected/d1f398ee-6c59-458f-b61b-113268629618-kube-api-access-xrrjt\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.466096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.465980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-service-ca\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.466096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.465999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f398ee-6c59-458f-b61b-113268629618-console-serving-cert\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.466096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.466020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-console-config\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.466096 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.466068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-oauth-serving-cert\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.466232 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.466133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f398ee-6c59-458f-b61b-113268629618-console-oauth-config\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.466232 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.466161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-trusted-ca-bundle\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.566557 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.566511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrrjt\" (UniqueName: \"kubernetes.io/projected/d1f398ee-6c59-458f-b61b-113268629618-kube-api-access-xrrjt\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.566739 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.566584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-service-ca\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.566739 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.566610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f398ee-6c59-458f-b61b-113268629618-console-serving-cert\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.566739 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.566625 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-console-config\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.566739 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.566647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-oauth-serving-cert\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.566964 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.566800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f398ee-6c59-458f-b61b-113268629618-console-oauth-config\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.566964 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.566842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-trusted-ca-bundle\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.567499 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.567444 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-console-config\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.567499 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.567492 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-oauth-serving-cert\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.567649 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.567447 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-service-ca\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.567649 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.567589 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1f398ee-6c59-458f-b61b-113268629618-trusted-ca-bundle\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.569232 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.569205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f398ee-6c59-458f-b61b-113268629618-console-serving-cert\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.569232 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.569222 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1f398ee-6c59-458f-b61b-113268629618-console-oauth-config\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.577398 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.577378 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrrjt\" (UniqueName: \"kubernetes.io/projected/d1f398ee-6c59-458f-b61b-113268629618-kube-api-access-xrrjt\") pod \"console-67c4444946-dk59q\" (UID: \"d1f398ee-6c59-458f-b61b-113268629618\") " pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:03.738426 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:03.738397 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:04.012681 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:04.012652 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c4444946-dk59q"] Sep 17 17:43:04.015117 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:43:04.015089 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f398ee_6c59_458f_b61b_113268629618.slice/crio-b152294d3e6cb0301f6a5006dae7284f70b04bc64387e85ba1d2565dc299accd WatchSource:0}: Error finding container b152294d3e6cb0301f6a5006dae7284f70b04bc64387e85ba1d2565dc299accd: Status 404 returned error can't find the container with id b152294d3e6cb0301f6a5006dae7284f70b04bc64387e85ba1d2565dc299accd Sep 17 17:43:04.803455 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:04.803415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c4444946-dk59q" event={"ID":"d1f398ee-6c59-458f-b61b-113268629618","Type":"ContainerStarted","Data":"be1651096d44f7d92140ca182e8d1f012d30058f1353b028ac259eae5e6fb2c1"} Sep 17 17:43:04.803870 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:04.803513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c4444946-dk59q" event={"ID":"d1f398ee-6c59-458f-b61b-113268629618","Type":"ContainerStarted","Data":"b152294d3e6cb0301f6a5006dae7284f70b04bc64387e85ba1d2565dc299accd"} Sep 17 17:43:04.823727 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:04.823680 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67c4444946-dk59q" podStartSLOduration=1.82366428 podStartE2EDuration="1.82366428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:43:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:43:04.823078625 +0000 UTC m=+503.272964760" watchObservedRunningTime="2026-09-17 17:43:04.82366428 +0000 UTC m=+503.273550410" Sep 17 17:43:07.765692 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.765655 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2"] Sep 17 17:43:07.769088 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.769072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:07.771969 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.771948 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Sep 17 17:43:07.772524 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.772505 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-95mp6\"" Sep 17 17:43:07.772870 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.772850 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 17 17:43:07.772977 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.772945 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 17 17:43:07.780736 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.780712 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2"] Sep 17 17:43:07.803549 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.803524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5x96\" (UniqueName: \"kubernetes.io/projected/1ba61c26-517c-44ec-b842-13d89fc97301-kube-api-access-l5x96\") pod \"llmisvc-controller-manager-645f9c8fd6-8sqt2\" (UID: \"1ba61c26-517c-44ec-b842-13d89fc97301\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:07.803675 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.803652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ba61c26-517c-44ec-b842-13d89fc97301-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-8sqt2\" (UID: \"1ba61c26-517c-44ec-b842-13d89fc97301\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:07.904866 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.904831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ba61c26-517c-44ec-b842-13d89fc97301-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-8sqt2\" (UID: \"1ba61c26-517c-44ec-b842-13d89fc97301\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:07.905055 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.904891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5x96\" (UniqueName: \"kubernetes.io/projected/1ba61c26-517c-44ec-b842-13d89fc97301-kube-api-access-l5x96\") pod \"llmisvc-controller-manager-645f9c8fd6-8sqt2\" (UID: \"1ba61c26-517c-44ec-b842-13d89fc97301\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:07.905055 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:43:07.905006 2562 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 17 17:43:07.905142 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:43:07.905078 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba61c26-517c-44ec-b842-13d89fc97301-cert podName:1ba61c26-517c-44ec-b842-13d89fc97301 nodeName:}" failed. No retries permitted until 2026-09-17 17:43:08.405056503 +0000 UTC m=+506.854942622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ba61c26-517c-44ec-b842-13d89fc97301-cert") pod "llmisvc-controller-manager-645f9c8fd6-8sqt2" (UID: "1ba61c26-517c-44ec-b842-13d89fc97301") : secret "llmisvc-webhook-server-cert" not found Sep 17 17:43:07.917186 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:07.917155 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5x96\" (UniqueName: \"kubernetes.io/projected/1ba61c26-517c-44ec-b842-13d89fc97301-kube-api-access-l5x96\") pod \"llmisvc-controller-manager-645f9c8fd6-8sqt2\" (UID: \"1ba61c26-517c-44ec-b842-13d89fc97301\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:08.410170 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:08.410124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ba61c26-517c-44ec-b842-13d89fc97301-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-8sqt2\" (UID: \"1ba61c26-517c-44ec-b842-13d89fc97301\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:08.412503 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:08.412462 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ba61c26-517c-44ec-b842-13d89fc97301-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-8sqt2\" (UID: \"1ba61c26-517c-44ec-b842-13d89fc97301\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:08.679710 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:08.679614 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:08.948919 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:08.948795 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2"] Sep 17 17:43:08.951043 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:43:08.951015 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1ba61c26_517c_44ec_b842_13d89fc97301.slice/crio-56c8d7d4a887e4af5be04db932217fad4a0831397b9398b194afe68e5d406cec WatchSource:0}: Error finding container 56c8d7d4a887e4af5be04db932217fad4a0831397b9398b194afe68e5d406cec: Status 404 returned error can't find the container with id 56c8d7d4a887e4af5be04db932217fad4a0831397b9398b194afe68e5d406cec Sep 17 17:43:09.827776 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:09.827722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" event={"ID":"1ba61c26-517c-44ec-b842-13d89fc97301","Type":"ContainerStarted","Data":"56c8d7d4a887e4af5be04db932217fad4a0831397b9398b194afe68e5d406cec"} Sep 17 17:43:11.838921 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:11.838889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" event={"ID":"1ba61c26-517c-44ec-b842-13d89fc97301","Type":"ContainerStarted","Data":"059ba1ca61322fb682f3d8844c2b3b13e53ef501c134a5651cdbeded62a8e5c5"} Sep 17 17:43:11.839304 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:11.838961 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:43:11.869326 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:11.869280 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" podStartSLOduration=2.5310803760000002 podStartE2EDuration="4.869265396s" totalImagesPullingTime="2.33818502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:43:11.868472259 +0000 UTC m=+510.318358390" watchObservedRunningTime="2026-09-17 17:43:11.869265396 +0000 UTC m=+510.319151594" Sep 17 17:43:13.738945 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:13.738911 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:13.739325 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:13.738968 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:13.743547 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:13.743527 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:13.851008 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:13.850976 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67c4444946-dk59q" Sep 17 17:43:13.915130 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:13.915080 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9c6cc48d-fkd5w"] Sep 17 17:43:38.936028 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:38.935922 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c9c6cc48d-fkd5w" podUID="4546df1a-3085-43a8-a78c-716dd15e74f5" containerName="console" containerID="cri-o://a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f" gracePeriod=15 Sep 17 17:43:39.178425 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.178397 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:43:39.297523 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.297467 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-oauth-config\") pod \"4546df1a-3085-43a8-a78c-716dd15e74f5\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " Sep 17 17:43:39.297710 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.297540 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-824vq\" (UniqueName: \"kubernetes.io/projected/4546df1a-3085-43a8-a78c-716dd15e74f5-kube-api-access-824vq\") pod \"4546df1a-3085-43a8-a78c-716dd15e74f5\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " Sep 17 17:43:39.297710 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.297563 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-console-config\") pod \"4546df1a-3085-43a8-a78c-716dd15e74f5\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " Sep 17 17:43:39.297710 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.297607 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-service-ca\") pod \"4546df1a-3085-43a8-a78c-716dd15e74f5\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " Sep 17 17:43:39.297710 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.297660 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-trusted-ca-bundle\") pod \"4546df1a-3085-43a8-a78c-716dd15e74f5\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " Sep 17 17:43:39.297710 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.297685 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-serving-cert\") pod \"4546df1a-3085-43a8-a78c-716dd15e74f5\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " Sep 17 17:43:39.297979 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.297719 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-oauth-serving-cert\") pod \"4546df1a-3085-43a8-a78c-716dd15e74f5\" (UID: \"4546df1a-3085-43a8-a78c-716dd15e74f5\") " Sep 17 17:43:39.298061 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.298031 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-console-config" (OuterVolumeSpecName: "console-config") pod "4546df1a-3085-43a8-a78c-716dd15e74f5" (UID: "4546df1a-3085-43a8-a78c-716dd15e74f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:39.298119 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.298046 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4546df1a-3085-43a8-a78c-716dd15e74f5" (UID: "4546df1a-3085-43a8-a78c-716dd15e74f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:39.298119 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.298079 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "4546df1a-3085-43a8-a78c-716dd15e74f5" (UID: "4546df1a-3085-43a8-a78c-716dd15e74f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:39.298311 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.298288 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4546df1a-3085-43a8-a78c-716dd15e74f5" (UID: "4546df1a-3085-43a8-a78c-716dd15e74f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:43:39.299802 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.299783 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4546df1a-3085-43a8-a78c-716dd15e74f5-kube-api-access-824vq" (OuterVolumeSpecName: "kube-api-access-824vq") pod "4546df1a-3085-43a8-a78c-716dd15e74f5" (UID: "4546df1a-3085-43a8-a78c-716dd15e74f5"). InnerVolumeSpecName "kube-api-access-824vq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:43:39.300158 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.300140 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4546df1a-3085-43a8-a78c-716dd15e74f5" (UID: "4546df1a-3085-43a8-a78c-716dd15e74f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:39.300224 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.300186 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4546df1a-3085-43a8-a78c-716dd15e74f5" (UID: "4546df1a-3085-43a8-a78c-716dd15e74f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:43:39.398692 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.398646 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-service-ca\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:43:39.398692 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.398680 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-trusted-ca-bundle\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:43:39.398692 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.398691 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-serving-cert\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:43:39.398692 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.398700 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-oauth-serving-cert\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:43:39.398966 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.398710 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4546df1a-3085-43a8-a78c-716dd15e74f5-console-oauth-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:43:39.398966 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.398719 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-824vq\" (UniqueName: \"kubernetes.io/projected/4546df1a-3085-43a8-a78c-716dd15e74f5-kube-api-access-824vq\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:43:39.398966 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.398728 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4546df1a-3085-43a8-a78c-716dd15e74f5-console-config\") on node \"ip-10-0-138-116.ec2.internal\" DevicePath \"\"" Sep 17 17:43:39.963438 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.963403 2562 generic.go:356] "Generic (PLEG): container finished" podID="4546df1a-3085-43a8-a78c-716dd15e74f5" containerID="a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f" exitCode=0 Sep 17 17:43:39.963845 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.963462 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9c6cc48d-fkd5w" Sep 17 17:43:39.963845 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.963498 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9c6cc48d-fkd5w" event={"ID":"4546df1a-3085-43a8-a78c-716dd15e74f5","Type":"ContainerDied","Data":"a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f"} Sep 17 17:43:39.963845 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.963568 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9c6cc48d-fkd5w" event={"ID":"4546df1a-3085-43a8-a78c-716dd15e74f5","Type":"ContainerDied","Data":"60811addd0ee93d780df333d9f2c4c441bcf41edc85feb7042f020b0b56f6e75"} Sep 17 17:43:39.963845 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.963593 2562 scope.go:117] "RemoveContainer" containerID="a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f" Sep 17 17:43:39.971780 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.971762 2562 scope.go:117] "RemoveContainer" containerID="a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f" Sep 17 17:43:39.972068 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:43:39.972049 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f\": container with ID starting with a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f not found: ID does not exist" containerID="a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f" Sep 17 17:43:39.972124 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.972084 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f"} err="failed to get container status \"a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f\": rpc error: code = NotFound desc = could not find container \"a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f\": container with ID starting with a036d6bde2c15a52532703bf46741865076277ea3e78f306639369be45cb5b8f not found: ID does not exist" Sep 17 17:43:39.984887 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.984856 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9c6cc48d-fkd5w"] Sep 17 17:43:39.986859 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:39.986834 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c9c6cc48d-fkd5w"] Sep 17 17:43:41.753952 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:41.753915 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4546df1a-3085-43a8-a78c-716dd15e74f5" path="/var/lib/kubelet/pods/4546df1a-3085-43a8-a78c-716dd15e74f5/volumes" Sep 17 17:43:42.845276 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:43:42.845241 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-8sqt2" Sep 17 17:44:25.880746 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.880709 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-b4bp6"] Sep 17 17:44:25.881149 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.881038 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4546df1a-3085-43a8-a78c-716dd15e74f5" containerName="console" Sep 17 17:44:25.881149 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.881049 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4546df1a-3085-43a8-a78c-716dd15e74f5" containerName="console" Sep 17 17:44:25.881149 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.881106 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4546df1a-3085-43a8-a78c-716dd15e74f5" containerName="console" Sep 17 17:44:25.884030 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.884014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:25.886815 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:44:25.886788 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"model-serving-api-7b954ffc95-b4bp6\" is forbidden: User \"system:node:ip-10-0-138-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-138-116.ec2.internal' and this object" podUID="5b62ee4a-4152-4427-b512-fcb95fcda2aa" pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:25.887010 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:44:25.886982 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"model-serving-api-dockercfg-n4ncf\" is forbidden: User \"system:node:ip-10-0-138-116.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-138-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-n4ncf\"" type="*v1.Secret" Sep 17 17:44:25.887109 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:44:25.887045 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"model-serving-api-tls\" is forbidden: User \"system:node:ip-10-0-138-116.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-138-116.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"model-serving-api-tls\"" type="*v1.Secret" Sep 17 17:44:25.923791 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.923761 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-b4bp6"] Sep 17 17:44:25.937078 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.937050 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7b966d7984-6kk4q"] Sep 17 17:44:25.940884 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.940865 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:25.944645 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.944623 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\"" Sep 17 17:44:25.945499 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.945465 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Sep 17 17:44:25.945499 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.945493 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-nv98j\"" Sep 17 17:44:25.952381 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.952359 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-6kk4q"] Sep 17 17:44:25.988544 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.988517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b62ee4a-4152-4427-b512-fcb95fcda2aa-tls-certs\") pod \"model-serving-api-7b954ffc95-b4bp6\" (UID: \"5b62ee4a-4152-4427-b512-fcb95fcda2aa\") " pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:25.988666 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:25.988587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk5n9\" (UniqueName: \"kubernetes.io/projected/5b62ee4a-4152-4427-b512-fcb95fcda2aa-kube-api-access-sk5n9\") pod \"model-serving-api-7b954ffc95-b4bp6\" (UID: \"5b62ee4a-4152-4427-b512-fcb95fcda2aa\") " pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:26.089372 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.089340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b62ee4a-4152-4427-b512-fcb95fcda2aa-tls-certs\") pod \"model-serving-api-7b954ffc95-b4bp6\" (UID: \"5b62ee4a-4152-4427-b512-fcb95fcda2aa\") " pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:26.089582 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.089399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d7d015-ec4b-4a87-8a34-db81b48f1fee-cert\") pod \"odh-model-controller-7b966d7984-6kk4q\" (UID: \"d7d7d015-ec4b-4a87-8a34-db81b48f1fee\") " pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.089582 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.089429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk5n9\" (UniqueName: \"kubernetes.io/projected/5b62ee4a-4152-4427-b512-fcb95fcda2aa-kube-api-access-sk5n9\") pod \"model-serving-api-7b954ffc95-b4bp6\" (UID: \"5b62ee4a-4152-4427-b512-fcb95fcda2aa\") " pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:26.089582 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.089446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc2j6\" (UniqueName: \"kubernetes.io/projected/d7d7d015-ec4b-4a87-8a34-db81b48f1fee-kube-api-access-kc2j6\") pod \"odh-model-controller-7b966d7984-6kk4q\" (UID: \"d7d7d015-ec4b-4a87-8a34-db81b48f1fee\") " pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.089582 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.089494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7d7d015-ec4b-4a87-8a34-db81b48f1fee-metrics-certs\") pod \"odh-model-controller-7b966d7984-6kk4q\" (UID: \"d7d7d015-ec4b-4a87-8a34-db81b48f1fee\") " pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.099590 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.099570 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk5n9\" (UniqueName: \"kubernetes.io/projected/5b62ee4a-4152-4427-b512-fcb95fcda2aa-kube-api-access-sk5n9\") pod \"model-serving-api-7b954ffc95-b4bp6\" (UID: \"5b62ee4a-4152-4427-b512-fcb95fcda2aa\") " pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:26.190213 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.190119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc2j6\" (UniqueName: \"kubernetes.io/projected/d7d7d015-ec4b-4a87-8a34-db81b48f1fee-kube-api-access-kc2j6\") pod \"odh-model-controller-7b966d7984-6kk4q\" (UID: \"d7d7d015-ec4b-4a87-8a34-db81b48f1fee\") " pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.190213 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.190173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7d7d015-ec4b-4a87-8a34-db81b48f1fee-metrics-certs\") pod \"odh-model-controller-7b966d7984-6kk4q\" (UID: \"d7d7d015-ec4b-4a87-8a34-db81b48f1fee\") " pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.190451 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.190255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d7d015-ec4b-4a87-8a34-db81b48f1fee-cert\") pod \"odh-model-controller-7b966d7984-6kk4q\" (UID: \"d7d7d015-ec4b-4a87-8a34-db81b48f1fee\") " pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.192654 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.192620 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7d7d015-ec4b-4a87-8a34-db81b48f1fee-metrics-certs\") pod \"odh-model-controller-7b966d7984-6kk4q\" (UID: \"d7d7d015-ec4b-4a87-8a34-db81b48f1fee\") " pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.192767 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.192661 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7d7d015-ec4b-4a87-8a34-db81b48f1fee-cert\") pod \"odh-model-controller-7b966d7984-6kk4q\" (UID: \"d7d7d015-ec4b-4a87-8a34-db81b48f1fee\") " pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.199991 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.199971 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc2j6\" (UniqueName: \"kubernetes.io/projected/d7d7d015-ec4b-4a87-8a34-db81b48f1fee-kube-api-access-kc2j6\") pod \"odh-model-controller-7b966d7984-6kk4q\" (UID: \"d7d7d015-ec4b-4a87-8a34-db81b48f1fee\") " pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.251671 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.251644 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:26.524351 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:26.524316 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-6kk4q"] Sep 17 17:44:26.527497 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:44:26.527460 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d7d015_ec4b_4a87_8a34_db81b48f1fee.slice/crio-f7e55e75811a9e1f9c18ea2dab46d0acc72dc845a97ebf2ec8bfc0fe4342b5dd WatchSource:0}: Error finding container f7e55e75811a9e1f9c18ea2dab46d0acc72dc845a97ebf2ec8bfc0fe4342b5dd: Status 404 returned error can't find the container with id f7e55e75811a9e1f9c18ea2dab46d0acc72dc845a97ebf2ec8bfc0fe4342b5dd Sep 17 17:44:27.053589 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:27.053556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-n4ncf\"" Sep 17 17:44:27.090013 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:44:27.089989 2562 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: failed to sync secret cache: timed out waiting for the condition Sep 17 17:44:27.090158 ip-10-0-138-116 kubenswrapper[2562]: E0917 17:44:27.090057 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b62ee4a-4152-4427-b512-fcb95fcda2aa-tls-certs podName:5b62ee4a-4152-4427-b512-fcb95fcda2aa nodeName:}" failed. No retries permitted until 2026-09-17 17:44:27.590042115 +0000 UTC m=+586.039928223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5b62ee4a-4152-4427-b512-fcb95fcda2aa-tls-certs") pod "model-serving-api-7b954ffc95-b4bp6" (UID: "5b62ee4a-4152-4427-b512-fcb95fcda2aa") : failed to sync secret cache: timed out waiting for the condition Sep 17 17:44:27.178590 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:27.178536 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-6kk4q" event={"ID":"d7d7d015-ec4b-4a87-8a34-db81b48f1fee","Type":"ContainerStarted","Data":"f7e55e75811a9e1f9c18ea2dab46d0acc72dc845a97ebf2ec8bfc0fe4342b5dd"} Sep 17 17:44:27.230499 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:27.230456 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Sep 17 17:44:27.603438 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:27.603404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b62ee4a-4152-4427-b512-fcb95fcda2aa-tls-certs\") pod \"model-serving-api-7b954ffc95-b4bp6\" (UID: \"5b62ee4a-4152-4427-b512-fcb95fcda2aa\") " pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:27.606047 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:27.606016 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b62ee4a-4152-4427-b512-fcb95fcda2aa-tls-certs\") pod \"model-serving-api-7b954ffc95-b4bp6\" (UID: \"5b62ee4a-4152-4427-b512-fcb95fcda2aa\") " pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:27.694251 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:27.694214 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:27.984952 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:27.984918 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-b4bp6"] Sep 17 17:44:29.032767 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:44:29.032734 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b62ee4a_4152_4427_b512_fcb95fcda2aa.slice/crio-72d21c633a724938d6ef5b674b8cc8067a6f4b3807f9b96e6b1107bf450e1d4c WatchSource:0}: Error finding container 72d21c633a724938d6ef5b674b8cc8067a6f4b3807f9b96e6b1107bf450e1d4c: Status 404 returned error can't find the container with id 72d21c633a724938d6ef5b674b8cc8067a6f4b3807f9b96e6b1107bf450e1d4c Sep 17 17:44:29.190369 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:29.190323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-6kk4q" event={"ID":"d7d7d015-ec4b-4a87-8a34-db81b48f1fee","Type":"ContainerStarted","Data":"a91e1bcf29f277a34946498db51439dbe4cd3f3b4e7922416febd5d456b1e272"} Sep 17 17:44:29.190565 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:29.190390 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:29.191610 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:29.191586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-b4bp6" event={"ID":"5b62ee4a-4152-4427-b512-fcb95fcda2aa","Type":"ContainerStarted","Data":"72d21c633a724938d6ef5b674b8cc8067a6f4b3807f9b96e6b1107bf450e1d4c"} Sep 17 17:44:29.222577 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:29.222534 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-7b966d7984-6kk4q" podStartSLOduration=1.667042236 podStartE2EDuration="4.222520709s" totalImagesPullingTime="2.555478473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:44:29.22205853 +0000 UTC m=+587.671944661" watchObservedRunningTime="2026-09-17 17:44:29.222520709 +0000 UTC m=+587.672406838" Sep 17 17:44:32.209021 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:32.208985 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-b4bp6" event={"ID":"5b62ee4a-4152-4427-b512-fcb95fcda2aa","Type":"ContainerStarted","Data":"d2a8d7ff3a5fc709a2ab6e6cbd394203c8ec5274c38a3cb698c043d1fa6e6e9b"} Sep 17 17:44:32.209513 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:32.209128 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:40.200870 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:40.200834 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7b966d7984-6kk4q" Sep 17 17:44:40.222202 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:40.222151 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-b4bp6" podStartSLOduration=12.852794092 podStartE2EDuration="15.222136765s" totalImagesPullingTime="2.369342673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:44:32.239965283 +0000 UTC m=+590.689851412" watchObservedRunningTime="2026-09-17 17:44:40.222136765 +0000 UTC m=+598.672022924" Sep 17 17:44:43.217226 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:43.217192 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-b4bp6" Sep 17 17:44:43.647975 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:43.647950 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:44:43.653282 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:44:43.653261 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:46:21.253041 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.253011 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv"] Sep 17 17:46:21.256212 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.256196 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.258994 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.258973 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Sep 17 17:46:21.259259 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.259241 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Sep 17 17:46:21.259900 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.259886 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-kcx4l\"" Sep 17 17:46:21.269300 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.269283 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv"] Sep 17 17:46:21.279831 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.279805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/fb079df4-f9a9-4f45-8f99-1df23d6571b4-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-8wbtv\" (UID: \"fb079df4-f9a9-4f45-8f99-1df23d6571b4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.279952 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.279848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp787\" (UniqueName: \"kubernetes.io/projected/fb079df4-f9a9-4f45-8f99-1df23d6571b4-kube-api-access-lp787\") pod \"seaweedfs-tls-serving-67b7477c6d-8wbtv\" (UID: \"fb079df4-f9a9-4f45-8f99-1df23d6571b4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.279952 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.279876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fb079df4-f9a9-4f45-8f99-1df23d6571b4-data\") pod \"seaweedfs-tls-serving-67b7477c6d-8wbtv\" (UID: \"fb079df4-f9a9-4f45-8f99-1df23d6571b4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.381188 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.381154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp787\" (UniqueName: \"kubernetes.io/projected/fb079df4-f9a9-4f45-8f99-1df23d6571b4-kube-api-access-lp787\") pod \"seaweedfs-tls-serving-67b7477c6d-8wbtv\" (UID: \"fb079df4-f9a9-4f45-8f99-1df23d6571b4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.381362 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.381200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fb079df4-f9a9-4f45-8f99-1df23d6571b4-data\") pod \"seaweedfs-tls-serving-67b7477c6d-8wbtv\" (UID: \"fb079df4-f9a9-4f45-8f99-1df23d6571b4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.381362 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.381279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/fb079df4-f9a9-4f45-8f99-1df23d6571b4-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-8wbtv\" (UID: \"fb079df4-f9a9-4f45-8f99-1df23d6571b4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.381651 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.381631 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fb079df4-f9a9-4f45-8f99-1df23d6571b4-data\") pod \"seaweedfs-tls-serving-67b7477c6d-8wbtv\" (UID: \"fb079df4-f9a9-4f45-8f99-1df23d6571b4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.383725 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.383699 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/fb079df4-f9a9-4f45-8f99-1df23d6571b4-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-8wbtv\" (UID: \"fb079df4-f9a9-4f45-8f99-1df23d6571b4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.392880 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.392847 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp787\" (UniqueName: \"kubernetes.io/projected/fb079df4-f9a9-4f45-8f99-1df23d6571b4-kube-api-access-lp787\") pod \"seaweedfs-tls-serving-67b7477c6d-8wbtv\" (UID: \"fb079df4-f9a9-4f45-8f99-1df23d6571b4\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.565865 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.565829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" Sep 17 17:46:21.853237 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:21.853135 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv"] Sep 17 17:46:21.856002 ip-10-0-138-116 kubenswrapper[2562]: W0917 17:46:21.855977 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb079df4_f9a9_4f45_8f99_1df23d6571b4.slice/crio-1f643ce40bf037adff5276d42d0c86fb1508ed7a7c7a29e1150ba84bde9043dd WatchSource:0}: Error finding container 1f643ce40bf037adff5276d42d0c86fb1508ed7a7c7a29e1150ba84bde9043dd: Status 404 returned error can't find the container with id 1f643ce40bf037adff5276d42d0c86fb1508ed7a7c7a29e1150ba84bde9043dd Sep 17 17:46:22.703345 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:22.703304 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" event={"ID":"fb079df4-f9a9-4f45-8f99-1df23d6571b4","Type":"ContainerStarted","Data":"1f643ce40bf037adff5276d42d0c86fb1508ed7a7c7a29e1150ba84bde9043dd"} Sep 17 17:46:24.715328 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:24.715296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" event={"ID":"fb079df4-f9a9-4f45-8f99-1df23d6571b4","Type":"ContainerStarted","Data":"67253fdd8336bbe94ef62ba1f08f559f88953da123709106ec4fe1c090066c49"} Sep 17 17:46:24.740728 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:46:24.740680 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-8wbtv" podStartSLOduration=1.0512117 podStartE2EDuration="3.74066306s" totalImagesPullingTime="2.68945136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:46:24.739094119 +0000 UTC m=+703.188980250" watchObservedRunningTime="2026-09-17 17:46:24.74066306 +0000 UTC m=+703.190549190" Sep 17 17:49:43.676080 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:49:43.676055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:49:43.678318 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:49:43.678299 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:54:43.711306 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:54:43.711278 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:54:43.711766 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:54:43.711278 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:59:43.737262 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:59:43.737233 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 17:59:43.739616 ip-10-0-138-116 kubenswrapper[2562]: I0917 17:59:43.739597 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:04:43.765876 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:04:43.765847 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:04:43.768035 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:04:43.768012 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:09:43.792815 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:09:43.792778 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:09:43.796641 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:09:43.796618 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:14:43.825873 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:14:43.825843 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:14:43.830505 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:14:43.830468 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:19:43.853372 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:19:43.853304 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:19:43.859083 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:19:43.859063 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:24:43.880400 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:24:43.880368 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:24:43.886830 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:24:43.886803 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:29:43.907851 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:29:43.907816 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:29:43.914756 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:29:43.914732 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:31:21.017206 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:21.017177 2562 ???:1] "http: TLS handshake error from 10.0.133.139:51604: EOF" Sep 17 18:31:21.022455 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:21.022430 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ftr75_3bacd02a-d64e-47c1-9a67-fe506b86dc0c/global-pull-secret-syncer/0.log" Sep 17 18:31:21.120986 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:21.120955 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-npk2q_33b72a7d-7b44-46e7-af04-08d01670bb35/konnectivity-agent/0.log" Sep 17 18:31:21.237539 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:21.237513 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-116.ec2.internal_974c10c54eca630105f59e37102fa24a/haproxy/0.log" Sep 17 18:31:25.054946 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.054870 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b6d5700-8a05-4a05-933f-b9d1fdae45fb/alertmanager/0.log" Sep 17 18:31:25.092782 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.092737 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b6d5700-8a05-4a05-933f-b9d1fdae45fb/config-reloader/0.log" Sep 17 18:31:25.135098 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.135067 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b6d5700-8a05-4a05-933f-b9d1fdae45fb/kube-rbac-proxy-web/0.log" Sep 17 18:31:25.170565 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.170542 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b6d5700-8a05-4a05-933f-b9d1fdae45fb/kube-rbac-proxy/0.log" Sep 17 18:31:25.213654 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.213623 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b6d5700-8a05-4a05-933f-b9d1fdae45fb/kube-rbac-proxy-metric/0.log" Sep 17 18:31:25.259371 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.259345 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b6d5700-8a05-4a05-933f-b9d1fdae45fb/prom-label-proxy/0.log" Sep 17 18:31:25.309495 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.309413 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4b6d5700-8a05-4a05-933f-b9d1fdae45fb/init-config-reloader/0.log" Sep 17 18:31:25.374560 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.374536 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-snhg2_939c3109-7819-4fe8-8dd9-187fa766aca7/cluster-monitoring-operator/0.log" Sep 17 18:31:25.507123 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.507094 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c74c4b5f5-9rhxz_bf7bd9c9-d157-4711-9967-942c2afa1ae2/metrics-server/0.log" Sep 17 18:31:25.544272 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.544241 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-hn9wh_48122271-75ad-4f4d-abe0-401d049e82c9/monitoring-plugin/0.log" Sep 17 18:31:25.583368 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.583297 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htskq_1e56a97e-3663-4662-a6c5-da290b929a12/node-exporter/0.log" Sep 17 18:31:25.610245 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.610222 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htskq_1e56a97e-3663-4662-a6c5-da290b929a12/kube-rbac-proxy/0.log" Sep 17 18:31:25.639512 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:25.639471 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htskq_1e56a97e-3663-4662-a6c5-da290b929a12/init-textfile/0.log" Sep 17 18:31:26.249665 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:26.249637 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fd47997c6-hwtf7_8377fbda-32a0-4d03-9bda-9887d5327f29/telemeter-client/0.log" Sep 17 18:31:26.273664 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:26.273639 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fd47997c6-hwtf7_8377fbda-32a0-4d03-9bda-9887d5327f29/reload/0.log" Sep 17 18:31:26.320622 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:26.320581 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fd47997c6-hwtf7_8377fbda-32a0-4d03-9bda-9887d5327f29/kube-rbac-proxy/0.log" Sep 17 18:31:28.958579 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:28.958442 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67c4444946-dk59q_d1f398ee-6c59-458f-b61b-113268629618/console/0.log" Sep 17 18:31:29.001402 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.001373 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-k5cm2_9c5ee19c-eb6a-46c3-aa2a-c7a1114514dd/download-server/0.log" Sep 17 18:31:29.550636 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.550602 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5s492/perf-node-gather-daemonset-w525l"] Sep 17 18:31:29.554048 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.554030 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.556878 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.556857 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5s492\"/\"openshift-service-ca.crt\"" Sep 17 18:31:29.557027 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.557011 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5s492\"/\"default-dockercfg-lrg5v\"" Sep 17 18:31:29.557679 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.557666 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5s492\"/\"kube-root-ca.crt\"" Sep 17 18:31:29.562847 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.562827 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5s492/perf-node-gather-daemonset-w525l"] Sep 17 18:31:29.623579 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.623545 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-2szcl_fb7d3a49-3f14-4035-9ef4-0425b7ebbcae/volume-data-source-validator/0.log" Sep 17 18:31:29.668541 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.668509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-lib-modules\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.668541 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.668543 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-podres\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.668786 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.668565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt4v4\" (UniqueName: \"kubernetes.io/projected/4e8a5d82-4535-433e-9f41-a95628ff51e4-kube-api-access-jt4v4\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.668786 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.668683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-sys\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.668786 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.668733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-proc\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.769517 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.769463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-lib-modules\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.769517 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.769522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-podres\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.769757 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.769547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt4v4\" (UniqueName: \"kubernetes.io/projected/4e8a5d82-4535-433e-9f41-a95628ff51e4-kube-api-access-jt4v4\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.769757 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.769638 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-lib-modules\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.769757 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.769680 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-podres\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.769757 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.769687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-sys\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.769757 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.769730 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-sys\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.769757 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.769737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-proc\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.769994 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.769804 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e8a5d82-4535-433e-9f41-a95628ff51e4-proc\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.778071 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.778053 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt4v4\" (UniqueName: \"kubernetes.io/projected/4e8a5d82-4535-433e-9f41-a95628ff51e4-kube-api-access-jt4v4\") pod \"perf-node-gather-daemonset-w525l\" (UID: \"4e8a5d82-4535-433e-9f41-a95628ff51e4\") " pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:29.864473 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:29.864373 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:30.138089 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:30.138063 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5s492/perf-node-gather-daemonset-w525l"] Sep 17 18:31:30.140445 ip-10-0-138-116 kubenswrapper[2562]: W0917 18:31:30.140412 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4e8a5d82_4535_433e_9f41_a95628ff51e4.slice/crio-5aab713879238de289555c6fdd9167bb17647f9505c32550fab256591a3836ba WatchSource:0}: Error finding container 5aab713879238de289555c6fdd9167bb17647f9505c32550fab256591a3836ba: Status 404 returned error can't find the container with id 5aab713879238de289555c6fdd9167bb17647f9505c32550fab256591a3836ba Sep 17 18:31:30.701399 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:30.701371 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8l9j_087b37b5-cb65-423a-b7f1-a95a764a45b4/dns/0.log" Sep 17 18:31:30.728145 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:30.728119 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8l9j_087b37b5-cb65-423a-b7f1-a95a764a45b4/kube-rbac-proxy/0.log" Sep 17 18:31:30.757448 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:30.757417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" event={"ID":"4e8a5d82-4535-433e-9f41-a95628ff51e4","Type":"ContainerStarted","Data":"d6587f85e81560897b48c415b8f850a816303aa8e10fecb0a0a036b0a718b1fe"} Sep 17 18:31:30.757630 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:30.757467 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" event={"ID":"4e8a5d82-4535-433e-9f41-a95628ff51e4","Type":"ContainerStarted","Data":"5aab713879238de289555c6fdd9167bb17647f9505c32550fab256591a3836ba"} Sep 17 18:31:30.757630 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:30.757516 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:30.774925 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:30.774873 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" podStartSLOduration=1.774857827 podStartE2EDuration="1.774857827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:31:30.773108983 +0000 UTC m=+3409.222995112" watchObservedRunningTime="2026-09-17 18:31:30.774857827 +0000 UTC m=+3409.224743956" Sep 17 18:31:30.786683 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:30.786662 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mbvzt_34e63e2f-5e8b-410b-9df5-65e8686cd545/dns-node-resolver/0.log" Sep 17 18:31:31.285126 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:31.285095 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b895b957-sxpz7_71cf254a-fa8f-4163-911b-85fc3061d103/registry/0.log" Sep 17 18:31:31.311820 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:31.311791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fm4h_62b695b7-eb68-45ac-8407-7f213aa2a087/node-ca/0.log" Sep 17 18:31:32.147518 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:32.147491 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d7c9949b-98b2q_e26f0b1b-8147-48a3-b742-07341db1c109/router/0.log" Sep 17 18:31:32.488724 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:32.488692 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4fq65_ee20a8ad-6e24-40dd-b3ba-c3fcf1639375/serve-healthcheck-canary/0.log" Sep 17 18:31:32.901943 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:32.901866 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-dtl88_b702e320-39d6-43cd-aecb-3fdac70f15fb/insights-operator/0.log" Sep 17 18:31:32.902625 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:32.902605 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-dtl88_b702e320-39d6-43cd-aecb-3fdac70f15fb/insights-operator/1.log" Sep 17 18:31:33.091147 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:33.091114 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5lqq_b1d454c2-4885-4017-9132-7680f40cc963/kube-rbac-proxy/0.log" Sep 17 18:31:33.119267 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:33.119246 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5lqq_b1d454c2-4885-4017-9132-7680f40cc963/exporter/0.log" Sep 17 18:31:33.149822 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:33.149802 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l5lqq_b1d454c2-4885-4017-9132-7680f40cc963/extractor/0.log" Sep 17 18:31:35.808043 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:35.808005 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-8sqt2_1ba61c26-517c-44ec-b842-13d89fc97301/manager/0.log" Sep 17 18:31:35.845135 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:35.845108 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-b4bp6_5b62ee4a-4152-4427-b512-fcb95fcda2aa/server/0.log" Sep 17 18:31:36.118270 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:36.118188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-7b966d7984-6kk4q_d7d7d015-ec4b-4a87-8a34-db81b48f1fee/manager/0.log" Sep 17 18:31:36.375102 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:36.375030 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-8wbtv_fb079df4-f9a9-4f45-8f99-1df23d6571b4/seaweedfs-tls-serving/0.log" Sep 17 18:31:36.772429 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:36.772399 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5s492/perf-node-gather-daemonset-w525l" Sep 17 18:31:41.038360 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:41.038328 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-nnb5q_52ea0606-0389-4f4d-8da2-c91a2c882a80/migrator/0.log" Sep 17 18:31:41.064665 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:41.064587 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-nnb5q_52ea0606-0389-4f4d-8da2-c91a2c882a80/graceful-termination/0.log" Sep 17 18:31:42.316061 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:42.316032 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mx2t_8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5/kube-multus-additional-cni-plugins/0.log" Sep 17 18:31:42.343147 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:42.343122 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mx2t_8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5/egress-router-binary-copy/0.log" Sep 17 18:31:42.369755 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:42.369726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mx2t_8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5/cni-plugins/0.log" Sep 17 18:31:42.395592 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:42.395568 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mx2t_8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5/bond-cni-plugin/0.log" Sep 17 18:31:42.422060 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:42.422038 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mx2t_8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5/routeoverride-cni/0.log" Sep 17 18:31:42.447627 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:42.447607 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mx2t_8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5/whereabouts-cni-bincopy/0.log" Sep 17 18:31:42.474377 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:42.474346 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mx2t_8a4ef12c-6b2f-40c2-9bf7-ffe8836297c5/whereabouts-cni/0.log" Sep 17 18:31:43.017744 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:43.017712 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xsx7m_ed4e9c2b-e3b2-41ee-8020-9058457dcf71/kube-multus/0.log" Sep 17 18:31:43.039851 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:43.039823 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6ntvh_9b7c7317-0809-4f38-8acb-709a2f66913f/network-metrics-daemon/0.log" Sep 17 18:31:43.064042 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:43.064020 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6ntvh_9b7c7317-0809-4f38-8acb-709a2f66913f/kube-rbac-proxy/0.log" Sep 17 18:31:44.240641 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:44.240611 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-controller/0.log" Sep 17 18:31:44.262622 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:44.262588 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/0.log" Sep 17 18:31:44.262766 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:44.262658 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovn-acl-logging/1.log" Sep 17 18:31:44.289494 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:44.289462 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/kube-rbac-proxy-node/0.log" Sep 17 18:31:44.314572 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:44.314546 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 18:31:44.336914 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:44.336888 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/northd/0.log" Sep 17 18:31:44.361114 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:44.361089 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/nbdb/0.log" Sep 17 18:31:44.383840 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:44.383815 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/sbdb/0.log" Sep 17 18:31:44.423629 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:44.423595 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hxld_08daf89f-358d-4053-85a7-7394070be216/ovnkube-controller/0.log" Sep 17 18:31:45.717333 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:45.717307 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5zfnp_3dc0303e-5ff1-4167-9ccb-1b8c078c5d6f/network-check-target-container/0.log" Sep 17 18:31:46.743715 ip-10-0-138-116 kubenswrapper[2562]: I0917 18:31:46.743690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jwf54_3579b563-b205-42d8-86f3-bfb21d947ace/iptables-alerter/0.log"