Sep 17 17:54:37.442914 ip-10-0-135-240 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 17:54:37.442925 ip-10-0-135-240 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 17:54:37.442932 ip-10-0-135-240 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 17:54:37.443081 ip-10-0-135-240 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 17:54:47.692070 ip-10-0-135-240 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 17:54:47.692088 ip-10-0-135-240 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a8b3626129d84e4ca786ed797c0a634a -- Sep 17 17:56:50.463921 ip-10-0-135-240 systemd[1]: Starting Kubernetes Kubelet... Sep 17 17:56:53.856252 ip-10-0-135-240 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:56:53.856252 ip-10-0-135-240 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 17:56:53.856252 ip-10-0-135-240 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:56:53.856252 ip-10-0-135-240 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 17:56:53.856252 ip-10-0-135-240 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:56:53.857166 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.856322 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 17:56:53.860318 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860303 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:56:53.860318 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860318 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860322 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860326 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860329 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860333 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860336 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860339 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860342 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860345 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860348 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860350 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860353 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860356 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860358 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860372 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860375 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860377 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860380 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860383 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860385 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:56:53.860382 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860389 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860391 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860394 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860397 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860400 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860402 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860405 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860408 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860410 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860413 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860417 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860421 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860424 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860426 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860429 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860432 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860435 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860437 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860440 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:56:53.860874 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860443 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860445 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860448 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860450 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860453 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860455 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860458 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860461 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860469 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860472 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860476 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860479 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860481 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860484 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860487 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860490 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860492 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860495 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860498 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860501 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:56:53.861341 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860503 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860506 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860509 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860511 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860514 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860516 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860519 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860522 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860526 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860530 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860533 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860537 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860540 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860543 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860547 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860550 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860553 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860556 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860559 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:56:53.861843 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860562 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860565 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860591 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860595 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860598 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860600 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860603 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860606 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860609 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860612 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860614 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860617 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860620 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860623 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860626 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860628 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860631 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860634 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860636 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.860639 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:56:53.862311 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861353 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861360 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861363 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861365 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861368 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861371 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861374 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861377 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861379 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861382 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861385 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861387 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861390 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861393 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861395 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861399 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861402 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861405 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861408 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861411 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:56:53.862845 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861414 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861417 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861420 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861423 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861426 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861428 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861431 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861434 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861436 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861439 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861441 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861445 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861447 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861450 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861453 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861456 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861458 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861461 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861464 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861466 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:56:53.863401 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861469 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861471 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861474 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861476 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861479 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861482 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861484 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861487 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861490 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861493 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861497 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861502 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861505 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861508 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861511 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861513 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861516 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861519 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861522 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:56:53.863910 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861524 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861527 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861529 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861532 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861534 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861537 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861539 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861542 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861545 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861547 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861550 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861552 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861555 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861558 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861560 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861563 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861565 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861568 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861570 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861590 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:56:53.864384 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861594 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861597 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861601 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861605 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861609 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861613 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861617 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861620 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861623 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861626 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861629 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861633 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861636 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861639 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861643 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861646 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861649 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861652 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861654 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:56:53.864880 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.861657 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862031 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862036 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862040 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862043 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862046 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862048 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862052 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862055 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862058 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862060 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862063 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862066 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862069 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862072 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862075 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862078 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862081 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862083 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862086 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:56:53.865340 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862089 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862092 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862095 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862097 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862100 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862103 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862105 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862108 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862110 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862113 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862116 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862118 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862122 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862126 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862129 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862132 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862136 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862139 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862143 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:56:53.865851 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862145 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862148 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862151 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862154 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862157 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862159 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862162 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862165 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862168 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862171 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862174 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862177 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862179 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862182 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862185 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862187 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862190 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862193 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862195 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862198 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:56:53.866325 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862201 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862204 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862206 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862209 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862211 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862214 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862217 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862220 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862223 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862225 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862228 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862232 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862234 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862237 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862239 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862242 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862244 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862247 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862249 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862252 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:56:53.866861 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862256 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862259 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862263 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862266 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862269 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862272 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862275 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862278 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862280 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862283 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862285 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862288 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862290 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862293 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862296 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862299 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862301 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862304 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862307 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862309 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:56:53.867352 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.862312 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862387 2582 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862418 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862425 2582 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862430 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862434 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862437 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862442 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862446 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862449 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862453 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862456 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862460 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862463 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862467 2582 flags.go:64] FLAG: --cgroup-root="" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862470 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862474 2582 flags.go:64] FLAG: --client-ca-file="" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862477 2582 flags.go:64] FLAG: --cloud-provider="external" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862480 2582 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862484 2582 flags.go:64] FLAG: --cluster-domain="" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862487 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862490 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862493 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862496 2582 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 17:56:53.867890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862500 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862503 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862506 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862510 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862513 2582 flags.go:64] FLAG: --contention-profiling="false" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862516 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862522 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862525 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862528 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862532 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862535 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862539 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862542 2582 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862545 2582 flags.go:64] FLAG: --enable-server="true" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862548 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862553 2582 flags.go:64] FLAG: --event-burst="100" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862556 2582 flags.go:64] FLAG: --event-qps="50" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862559 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862562 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862565 2582 flags.go:64] FLAG: --eviction-hard="" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862569 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862572 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862589 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862592 2582 flags.go:64] FLAG: --eviction-soft="" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862598 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 17:56:53.868468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862602 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862605 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862608 2582 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862611 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862614 2582 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862617 2582 flags.go:64] FLAG: --feature-gates="" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862621 2582 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862624 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862627 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862631 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862634 2582 flags.go:64] FLAG: --healthz-port="10248" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862637 2582 flags.go:64] FLAG: --help="false" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862640 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-135-240.ec2.internal" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862647 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862650 2582 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862654 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862657 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862661 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862664 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862667 2582 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862670 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862673 2582 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862676 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862679 2582 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 17:56:53.869114 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862682 2582 flags.go:64] FLAG: --kube-reserved="" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862686 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862689 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862692 2582 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862695 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862698 2582 flags.go:64] FLAG: --lock-file="" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862701 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862704 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862707 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862713 2582 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862716 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862719 2582 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862722 2582 flags.go:64] FLAG: --logging-format="text" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862725 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862728 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862731 2582 flags.go:64] FLAG: --manifest-url="" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862734 2582 flags.go:64] FLAG: --manifest-url-header="" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862739 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862742 2582 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862746 2582 flags.go:64] FLAG: --max-pods="110" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862749 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862754 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862757 2582 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862760 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862764 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 17:56:53.869804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862767 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862773 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862780 2582 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862783 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862786 2582 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862789 2582 flags.go:64] FLAG: --pod-cidr="" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862792 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862798 2582 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862802 2582 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862805 2582 flags.go:64] FLAG: --pods-per-core="0" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862808 2582 flags.go:64] FLAG: --port="10250" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862811 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862814 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0839c54136094e1b0" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862817 2582 flags.go:64] FLAG: --qos-reserved="" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862821 2582 flags.go:64] FLAG: --read-only-port="10255" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862824 2582 flags.go:64] FLAG: --register-node="true" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862827 2582 flags.go:64] FLAG: --register-with-taints="" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862831 2582 flags.go:64] FLAG: --registry-burst="10" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862834 2582 flags.go:64] FLAG: --registry-qps="5" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862838 2582 flags.go:64] FLAG: --reserved-cpus="" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862841 2582 flags.go:64] FLAG: --reserved-memory="" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862844 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862848 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862851 2582 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862854 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 17:56:53.870518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862857 2582 flags.go:64] FLAG: --runonce="false" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862860 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862863 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862869 2582 flags.go:64] FLAG: --seccomp-default="false" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862871 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862875 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862878 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862881 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862884 2582 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862889 2582 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862892 2582 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862896 2582 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862899 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862902 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862905 2582 flags.go:64] FLAG: --system-cgroups="" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862908 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862913 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862917 2582 flags.go:64] FLAG: --tls-cert-file="" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862919 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862924 2582 flags.go:64] FLAG: --tls-min-version="" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862927 2582 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862930 2582 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862933 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862936 2582 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862940 2582 flags.go:64] FLAG: --v="2" Sep 17 17:56:53.871480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862944 2582 flags.go:64] FLAG: --version="false" Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862948 2582 flags.go:64] FLAG: --vmodule="" Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862952 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.862956 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863070 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863073 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863076 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863080 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863083 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863086 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863090 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863093 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863096 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863099 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863102 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863104 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863108 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863111 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863114 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863116 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:56:53.872272 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863119 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863122 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863124 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863127 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863130 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863132 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863135 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863137 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863142 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863145 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863149 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863153 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863157 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863160 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863162 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863165 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863168 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863171 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863174 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:56:53.872790 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863178 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863181 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863183 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863187 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863190 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863193 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863196 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863198 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863202 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863208 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863211 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863215 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863218 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863221 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863223 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863227 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863230 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863233 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863236 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863239 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:56:53.873273 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863242 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863245 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863247 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863250 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863252 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863255 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863258 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863262 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863266 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863269 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863272 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863276 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863279 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863282 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863284 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863289 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863291 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863294 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863297 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863300 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:56:53.873783 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863302 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863306 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863309 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863312 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863315 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863317 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863320 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863323 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863325 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863328 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863331 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863333 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863336 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863339 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863341 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863344 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863346 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863349 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863352 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863355 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:56:53.874291 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863358 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863361 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863364 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.863366 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.863949 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.872725 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.872741 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.872761 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.872767 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872834 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872840 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872843 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872846 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872849 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872853 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:56:53.874803 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872855 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872858 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872862 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872865 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872868 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872871 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872874 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872877 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872879 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872882 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872885 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872887 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872890 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872893 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872896 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872899 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872902 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872905 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872908 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:56:53.875181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872911 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872916 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872919 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872921 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872924 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872927 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872930 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872933 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872936 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872939 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872941 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872944 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872948 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872953 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872956 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872959 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872962 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872965 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872968 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872971 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:56:53.875687 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872973 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872976 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872979 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872982 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872985 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872987 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872990 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872993 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872995 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.872998 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873001 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873003 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873006 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873009 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873011 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873014 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873016 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873019 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873022 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873025 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:56:53.876181 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873028 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873030 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873033 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873036 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873039 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873041 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873044 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873047 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873049 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873053 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873055 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873058 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873061 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873063 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873067 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873069 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873072 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873075 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873077 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873080 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:56:53.876682 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873083 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873085 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873088 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873092 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873095 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873098 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873101 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873104 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873106 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873109 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873112 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873115 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873117 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873120 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.873125 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:56:53.877164 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873254 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873260 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873263 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873266 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873268 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873271 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873274 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873277 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873280 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873283 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873285 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873288 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873291 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873294 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873297 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873300 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873302 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873305 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873307 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873310 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:56:53.877537 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873312 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873315 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873317 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873320 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873322 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873325 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873328 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873331 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873334 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873337 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873341 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873345 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873348 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873351 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873354 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873357 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873360 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873362 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873365 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:56:53.878041 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873367 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873370 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873372 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873375 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873377 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873380 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873384 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873388 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873390 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873393 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873396 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873399 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873401 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873404 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873407 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873409 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873412 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873415 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873418 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873420 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:56:53.878501 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873423 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873425 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873428 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873431 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873434 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873436 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873439 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873441 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873444 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873447 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873449 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873452 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873454 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873457 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873462 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873465 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873468 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873470 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873473 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873476 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:56:53.879137 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873479 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873482 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873484 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873487 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873489 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873492 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873495 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873497 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873500 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873503 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873505 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873508 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873510 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873514 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873517 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873520 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873522 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873525 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873528 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:56:53.879640 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:53.873531 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:56:53.880087 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.873536 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:56:53.880087 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.873673 2582 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 17:56:53.880087 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.875772 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 17:56:53.880087 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.876831 2582 server.go:1019] "Starting client certificate rotation" Sep 17 17:56:53.880087 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.876931 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:56:53.880087 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.877499 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:56:53.880087 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.879068 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:56:53.880265 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.880211 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:56:53.890322 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.890300 2582 log.go:25] "Validated CRI v1 runtime API" Sep 17 17:56:53.892084 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.892067 2582 log.go:25] "Validated CRI v1 image API" Sep 17 17:56:53.893023 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.893005 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 17:56:53.896134 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.896110 2582 fs.go:135] Filesystem UUIDs: map[4d7b71aa-41b7-4ba9-91d8-93e484f1aa88:/dev/nvme0n1p3 54e8c34e-3144-4896-bb13-51306cb0f6f6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 17 17:56:53.896223 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.896130 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 17:56:53.902787 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.902298 2582 manager.go:216] Machine: {Timestamp:2026-09-17 17:56:53.901785016 +0000 UTC m=+2.047710184 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113747 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec223b17f16284c20bab672a8be00891 SystemUUID:ec223b17-f162-84c2-0bab-672a8be00891 BootID:a8b36261-29d8-4e4c-a786-ed797c0a634a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cb:0b:68:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cb:0b:68:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:11:e3:1c:f7:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 17:56:53.902787 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.902772 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 17:56:53.902936 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.902888 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 17:56:53.904641 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.904548 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 17:56:53.905128 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.904744 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 17:56:53.906250 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.906228 2582 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 17:56:53.906250 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.906252 2582 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 17:56:53.906396 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.906264 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:56:53.906396 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.906298 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:56:53.906610 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.906413 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 17:56:53.910167 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.910153 2582 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:56:53.910311 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.910300 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 17:56:53.910396 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.910343 2582 kubelet.go:486] "Attempting to sync node with API server" Sep 17 17:56:53.910396 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.910359 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 17:56:53.910396 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.910381 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 17:56:53.910396 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.910394 2582 kubelet.go:398] "Adding apiserver pod source" Sep 17 17:56:53.910551 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.910407 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 17:56:53.910850 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.910836 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:56:53.910917 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.910859 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:56:53.918608 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.918573 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 17:56:53.921063 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.921044 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 17:56:53.921149 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.921083 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 17:56:53.922158 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922142 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 17:56:53.922239 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922169 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 17:56:53.922239 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922181 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 17:56:53.922239 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922193 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 17:56:53.922239 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922208 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 17:56:53.922239 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922223 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 17:56:53.922449 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922247 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 17:56:53.922449 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922256 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 17:56:53.922449 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922267 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 17:56:53.922449 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922278 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 17:56:53.922449 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922293 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 17:56:53.922449 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922303 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 17:56:53.922449 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922338 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 17:56:53.922449 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.922346 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 17:56:53.925225 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:53.925194 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 17:56:53.925723 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:53.925701 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 17:56:53.926235 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.926214 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:56:53.926725 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.926713 2582 server.go:1268] "Started kubelet" Sep 17 17:56:53.926805 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.926782 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 17:56:53.926869 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.926796 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 17:56:53.926869 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.926857 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 17:56:53.927626 ip-10-0-135-240 systemd[1]: Started Kubernetes Kubelet. Sep 17 17:56:53.928777 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.928761 2582 server.go:310] "Adding debug handlers to kubelet server" Sep 17 17:56:53.930344 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.930325 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 17:56:53.931856 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:53.931836 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 17:56:53.934238 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.934222 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 17:56:53.934330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.934239 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 17:56:53.934330 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:53.934295 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:53.934911 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.934749 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 17:56:53.934911 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.934770 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 17:56:53.934911 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.934756 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 17:56:53.935072 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.934939 2582 reconstruct.go:97] "Volume reconstruction finished" Sep 17 17:56:53.935072 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.934948 2582 reconciler.go:29] "Reconciler: start to sync state" Sep 17 17:56:53.935072 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.935010 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 17:56:53.935320 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.935290 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 17:56:53.935320 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.935320 2582 factory.go:55] Registering systemd factory Sep 17 17:56:53.935440 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.935329 2582 factory.go:223] Registration of the systemd container factory successfully Sep 17 17:56:53.935553 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.935534 2582 factory.go:153] Registering CRI-O factory Sep 17 17:56:53.935553 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.935550 2582 factory.go:223] Registration of the crio container factory successfully Sep 17 17:56:53.935699 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.935564 2582 factory.go:103] Registering Raw factory Sep 17 17:56:53.935699 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.935607 2582 manager.go:1196] Started watching for new ooms in manager Sep 17 17:56:53.938591 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.938560 2582 manager.go:349] Starting recovery of all containers Sep 17 17:56:53.958990 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.958962 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xxtrj" Sep 17 17:56:53.962138 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.962096 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 17:56:53.963531 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:53.963505 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 17:56:53.963820 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:53.963795 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 17:56:53.964682 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.964657 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xxtrj" Sep 17 17:56:53.966488 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:53.965483 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-240.ec2.internal.18d62d650b09b05f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-240.ec2.internal,UID:ip-10-0-135-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-240.ec2.internal,},FirstTimestamp:2026-09-17 17:56:53.926482015 +0000 UTC m=+2.072407232,LastTimestamp:2026-09-17 17:56:53.926482015 +0000 UTC m=+2.072407232,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-240.ec2.internal,}" Sep 17 17:56:53.968962 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.968939 2582 manager.go:354] Recovery completed Sep 17 17:56:53.973195 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.973181 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:56:53.975123 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.975109 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:56:53.975199 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.975134 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:56:53.975199 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.975145 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:56:53.975739 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.975724 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 17:56:53.975739 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.975737 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 17:56:53.975848 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.975725 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:56:53.975848 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.975757 2582 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:56:53.976432 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.976418 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:56:53.976471 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.976444 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:56:53.976471 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.976456 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:56:53.977890 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.977867 2582 policy_none.go:49] "None policy: Start" Sep 17 17:56:53.977966 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.977894 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 17:56:53.977966 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.977910 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 17:56:53.979864 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:53.979850 2582 policy_none.go:47] "Start" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.024168 2582 manager.go:337] "Starting Device Plugin manager" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.024211 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.024222 2582 server.go:87] "Starting device plugin registration server" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.024486 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.024508 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.024647 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.024737 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.024750 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.025309 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 17:56:54.027093 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.025367 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.077417 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.077386 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 17:56:54.077551 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.077441 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 17:56:54.077551 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.077470 2582 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 17:56:54.077551 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.077519 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 17:56:54.080433 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.080408 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:56:54.125795 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.125720 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:56:54.128133 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.128116 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:56:54.128223 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.128146 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:56:54.128223 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.128170 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:56:54.128223 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.128197 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.137426 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.137408 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.137479 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.137431 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-240.ec2.internal\": node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.164046 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.164017 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.178132 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.178085 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"] Sep 17 17:56:54.178200 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.178185 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:56:54.179257 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.179240 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:56:54.179362 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.179268 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:56:54.179362 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.179278 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:56:54.181379 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.181364 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:56:54.181515 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.181500 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.181572 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.181539 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:56:54.182738 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.182440 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:56:54.182738 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.182474 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:56:54.182738 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.182487 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:56:54.182960 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.182920 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:56:54.182960 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.182949 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:56:54.183063 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.182963 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:56:54.184590 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.184561 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.184669 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.184606 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:56:54.185377 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.185347 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:56:54.185377 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.185370 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:56:54.185502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.185386 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:56:54.211466 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.211435 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-240.ec2.internal\" not found" node="ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.215930 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.215910 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-240.ec2.internal\" not found" node="ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.236866 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.236840 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.236971 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.236871 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.236971 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.236894 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04ddfa7d8805c056a864c45acb85b2eb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"04ddfa7d8805c056a864c45acb85b2eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.264616 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.264592 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.337612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.337566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.337612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.337612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04ddfa7d8805c056a864c45acb85b2eb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"04ddfa7d8805c056a864c45acb85b2eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.337790 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.337629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.337790 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.337655 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.337790 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.337657 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.337790 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.337675 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04ddfa7d8805c056a864c45acb85b2eb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"04ddfa7d8805c056a864c45acb85b2eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.365302 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.365273 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.466330 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.466227 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.515446 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.515412 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.519041 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.519007 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Sep 17 17:56:54.567460 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.567274 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.667829 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.667796 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.768395 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.768306 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.868896 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.868849 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.877018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.876994 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 17:56:54.877169 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.877151 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 17:56:54.968995 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:54.968957 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:54.970075 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.970036 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:51:53 +0000 UTC" deadline="2028-06-18 08:44:15.316530396 +0000 UTC" Sep 17 17:56:54.970075 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:54.970069 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15350h47m20.346464905s" Sep 17 17:56:55.069746 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:55.069708 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:55.091903 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:55.091861 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507a24b2ffe92f3b87cfca5c4f26c0f5.slice/crio-d3bc31c75e216ab13395fa14073317dfc82e9f21ca47d8e8102303df23cea78e WatchSource:0}: Error finding container d3bc31c75e216ab13395fa14073317dfc82e9f21ca47d8e8102303df23cea78e: Status 404 returned error can't find the container with id d3bc31c75e216ab13395fa14073317dfc82e9f21ca47d8e8102303df23cea78e Sep 17 17:56:55.092396 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:55.092375 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ddfa7d8805c056a864c45acb85b2eb.slice/crio-6db74678c8034b2fbd72de3d440dd001ad0eeaf286c1c7d7d75a4ef2f8e885f4 WatchSource:0}: Error finding container 6db74678c8034b2fbd72de3d440dd001ad0eeaf286c1c7d7d75a4ef2f8e885f4: Status 404 returned error can't find the container with id 6db74678c8034b2fbd72de3d440dd001ad0eeaf286c1c7d7d75a4ef2f8e885f4 Sep 17 17:56:55.097227 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.097204 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:56:55.169865 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:55.169824 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:55.192734 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.192713 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:56:55.270828 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:55.270771 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:55.371286 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:55.371259 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Sep 17 17:56:55.435569 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.435546 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:56:55.469555 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.469524 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:56:55.535341 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.535302 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Sep 17 17:56:55.553124 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.553082 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:56:55.554271 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.554241 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Sep 17 17:56:55.566602 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.566493 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:56:55.752570 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.752499 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:56:55.911507 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.911474 2582 apiserver.go:52] "Watching apiserver" Sep 17 17:56:55.916841 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.916811 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 17:56:55.917238 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.917214 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-p6nzs","openshift-dns/node-resolver-62ddv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal","openshift-multus/multus-additional-cni-plugins-8v98r","openshift-multus/network-metrics-daemon-l2wd2","openshift-network-diagnostics/network-check-target-nqzkc","kube-system/global-pull-secret-syncer-gds4r","kube-system/konnectivity-agent-6tjqt","openshift-image-registry/node-ca-9l9j6","openshift-multus/multus-f6bj5","openshift-network-operator/iptables-alerter-8624r","openshift-ovn-kubernetes/ovnkube-node-8lhr7","kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z"] Sep 17 17:56:55.919693 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.919669 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:55.919814 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:55.919746 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:56:55.922551 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.922527 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:55.924879 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.924855 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:55.927205 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.926796 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 17:56:55.927205 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.926806 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-grfdw\"" Sep 17 17:56:55.927205 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.926986 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:56:55.927205 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.927081 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 17:56:55.927907 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.927543 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:55.929839 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.929814 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:55.929991 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:55.929965 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:56:55.932140 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.932119 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:56:55.932229 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:55.932213 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:56:55.934543 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.934518 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 17:56:55.934674 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.934654 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:55.937533 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.937127 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:56:55.937533 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.937296 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 17:56:55.937533 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.937315 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 17:56:55.937533 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.937332 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 17:56:55.937533 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.937449 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 17:56:55.937533 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.937537 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zs2vt\"" Sep 17 17:56:55.937892 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.937612 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 17:56:55.939387 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.939369 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:55.941335 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.941271 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 17:56:55.941956 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.941705 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 17:56:55.941956 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.941797 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-znm7s\"" Sep 17 17:56:55.941956 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.941705 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 17:56:55.942798 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.942403 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f6bj5" Sep 17 17:56:55.943078 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.943050 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 17:56:55.943284 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.943266 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 17:56:55.943385 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.943364 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qh27t\"" Sep 17 17:56:55.943524 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.943508 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 17:56:55.944882 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.944861 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:55.946951 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.946927 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-cnibin\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:55.947048 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.946975 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-cni-binary-copy\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:55.947048 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947003 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:55.947153 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947068 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-registration-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:55.947252 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fda8510-3a22-4893-85e3-6f8d335a90bd-serviceca\") pod \"node-ca-9l9j6\" (UID: \"8fda8510-3a22-4893-85e3-6f8d335a90bd\") " pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:55.947252 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947181 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/557e8783-4dae-46ee-be7e-90e81efe69d7-dbus\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:55.947252 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947209 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:55.947252 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947244 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:55.947468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947313 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-system-cni-dir\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:55.947468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947330 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-socket-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:55.947468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947369 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:55.947468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947385 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:55.947468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947406 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkp5z\" (UniqueName: \"kubernetes.io/projected/6dd258db-1cff-4db7-a043-b3505b84dfb7-kube-api-access-lkp5z\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:55.947468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947430 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-sys-fs\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:55.947468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947450 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkwdb\" (UniqueName: \"kubernetes.io/projected/8fda8510-3a22-4893-85e3-6f8d335a90bd-kube-api-access-fkwdb\") pod \"node-ca-9l9j6\" (UID: \"8fda8510-3a22-4893-85e3-6f8d335a90bd\") " pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:55.947468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947464 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8078e46-08b4-42dc-b26c-4c641ead8339-agent-certs\") pod \"konnectivity-agent-6tjqt\" (UID: \"e8078e46-08b4-42dc-b26c-4c641ead8339\") " pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947478 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947517 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrlbg\" (UniqueName: \"kubernetes.io/projected/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-kube-api-access-hrlbg\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947602 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54947b01-7381-4b3b-9b6a-768c4b771671-iptables-alerter-script\") pod \"iptables-alerter-8624r\" (UID: \"54947b01-7381-4b3b-9b6a-768c4b771671\") " pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54947b01-7381-4b3b-9b6a-768c4b771671-host-slash\") pod \"iptables-alerter-8624r\" (UID: \"54947b01-7381-4b3b-9b6a-768c4b771671\") " pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947675 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dx4s\" (UniqueName: \"kubernetes.io/projected/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-kube-api-access-7dx4s\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947718 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgsr5\" (UniqueName: \"kubernetes.io/projected/54947b01-7381-4b3b-9b6a-768c4b771671-kube-api-access-kgsr5\") pod \"iptables-alerter-8624r\" (UID: \"54947b01-7381-4b3b-9b6a-768c4b771671\") " pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947762 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-device-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947805 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947835 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947858 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fda8510-3a22-4893-85e3-6f8d335a90bd-host\") pod \"node-ca-9l9j6\" (UID: \"8fda8510-3a22-4893-85e3-6f8d335a90bd\") " pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:55.947906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947883 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8078e46-08b4-42dc-b26c-4c641ead8339-konnectivity-ca\") pod \"konnectivity-agent-6tjqt\" (UID: \"e8078e46-08b4-42dc-b26c-4c641ead8339\") " pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:56:55.948552 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.947935 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/557e8783-4dae-46ee-be7e-90e81efe69d7-kubelet-config\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:55.950173 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.950149 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 17:56:55.950565 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.950541 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:55.952595 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.952171 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 17:56:55.953450 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.953429 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bjnpk\"" Sep 17 17:56:55.953797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.953778 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 17:56:55.954185 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.954166 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 17:56:55.954404 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.954384 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 17:56:55.954548 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.954526 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cpt87\"" Sep 17 17:56:55.954632 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.954564 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-97qm6\"" Sep 17 17:56:55.954885 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.954864 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 17:56:55.954997 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.954961 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gzwx7\"" Sep 17 17:56:55.955270 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.955197 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:56:55.958882 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.958859 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 17:56:55.963090 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.963065 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 17:56:55.963550 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.963532 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 17:56:55.964393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.964374 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 17:56:55.966407 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.966388 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hdlzw\"" Sep 17 17:56:55.967006 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.966988 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 17:56:55.967295 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.967277 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 17:56:55.976948 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:55.976923 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:56:56.026342 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.026301 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xw7gr" Sep 17 17:56:56.036358 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.036326 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 17:56:56.047711 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.047678 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xw7gr" Sep 17 17:56:56.048767 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.048744 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-cnibin\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.048767 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.048774 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-registration-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.048940 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.048825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-run-k8s-cni-cncf-io\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.048940 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.048857 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-var-lib-kubelet\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.048940 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.048878 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-registration-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.048940 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.048897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-run-systemd\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.048940 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.048923 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/557e8783-4dae-46ee-be7e-90e81efe69d7-dbus\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:56.049188 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.048943 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-cnibin\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.049188 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.048953 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:56.049188 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049003 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-modprobe-d\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.049188 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-run-openvswitch\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.049188 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.049051 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:56:56.049188 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049070 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-ovn-node-metrics-cert\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.049188 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.049167 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret podName:557e8783-4dae-46ee-be7e-90e81efe69d7 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:56.549136925 +0000 UTC m=+4.695062080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret") pod "global-pull-secret-syncer-gds4r" (UID: "557e8783-4dae-46ee-be7e-90e81efe69d7") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049192 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/557e8783-4dae-46ee-be7e-90e81efe69d7-dbus\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-socket-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049253 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-multus-conf-dir\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049277 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-sysctl-d\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049300 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-sys\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049323 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970df45c-7b47-4c5d-ab8b-95daf1604734-tmp\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049347 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-var-lib-openvswitch\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049372 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-env-overrides\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049372 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-socket-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049427 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkp5z\" (UniqueName: \"kubernetes.io/projected/6dd258db-1cff-4db7-a043-b3505b84dfb7-kube-api-access-lkp5z\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-multus-cni-dir\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049482 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-ovnkube-script-lib\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.049502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049507 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-sys-fs\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049533 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8078e46-08b4-42dc-b26c-4c641ead8339-agent-certs\") pod \"konnectivity-agent-6tjqt\" (UID: \"e8078e46-08b4-42dc-b26c-4c641ead8339\") " pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049556 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-kubernetes\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049598 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-lib-modules\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049623 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-run-netns\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-ovnkube-config\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049742 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrlbg\" (UniqueName: \"kubernetes.io/projected/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-kube-api-access-hrlbg\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54947b01-7381-4b3b-9b6a-768c4b771671-host-slash\") pod \"iptables-alerter-8624r\" (UID: \"54947b01-7381-4b3b-9b6a-768c4b771671\") " pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049790 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-sys-fs\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dx4s\" (UniqueName: \"kubernetes.io/projected/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-kube-api-access-7dx4s\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-system-cni-dir\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049853 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-cnibin\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049884 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-var-lib-cni-bin\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-var-lib-kubelet\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.050031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049936 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-device-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.049979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050006 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050028 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-systemd\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050033 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050059 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-hostroot\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050095 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-host\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050111 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-log-socket\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050153 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fda8510-3a22-4893-85e3-6f8d335a90bd-host\") pod \"node-ca-9l9j6\" (UID: \"8fda8510-3a22-4893-85e3-6f8d335a90bd\") " pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050175 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-multus-socket-dir-parent\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050194 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-cni-netd\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-cni-binary-copy\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-sysctl-conf\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fda8510-3a22-4893-85e3-6f8d335a90bd-serviceca\") pod \"node-ca-9l9j6\" (UID: \"8fda8510-3a22-4893-85e3-6f8d335a90bd\") " pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.050679 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050385 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-system-cni-dir\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050495 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-device-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050519 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fda8510-3a22-4893-85e3-6f8d335a90bd-host\") pod \"node-ca-9l9j6\" (UID: \"8fda8510-3a22-4893-85e3-6f8d335a90bd\") " pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050540 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-system-cni-dir\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050561 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54947b01-7381-4b3b-9b6a-768c4b771671-host-slash\") pod \"iptables-alerter-8624r\" (UID: \"54947b01-7381-4b3b-9b6a-768c4b771671\") " pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050594 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-run-multus-certs\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050623 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpmm7\" (UniqueName: \"kubernetes.io/projected/449e669f-ccb6-4110-ac97-c540212b87ed-kube-api-access-qpmm7\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-cni-bin\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.050655 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050596 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050690 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/449e669f-ccb6-4110-ac97-c540212b87ed-cni-binary-copy\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050742 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-etc-kubernetes\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050790 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkwdb\" (UniqueName: \"kubernetes.io/projected/8fda8510-3a22-4893-85e3-6f8d335a90bd-kube-api-access-fkwdb\") pod \"node-ca-9l9j6\" (UID: \"8fda8510-3a22-4893-85e3-6f8d335a90bd\") " pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050816 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-var-lib-cni-multus\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050885 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-run-ovn-kubernetes\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050891 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.051331 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050915 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54947b01-7381-4b3b-9b6a-768c4b771671-iptables-alerter-script\") pod \"iptables-alerter-8624r\" (UID: \"54947b01-7381-4b3b-9b6a-768c4b771671\") " pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050942 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0baf25a-1695-4bef-8be0-42ac37b5d7fe-hosts-file\") pod \"node-resolver-62ddv\" (UID: \"b0baf25a-1695-4bef-8be0-42ac37b5d7fe\") " pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050988 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvrnw\" (UniqueName: \"kubernetes.io/projected/b0baf25a-1695-4bef-8be0-42ac37b5d7fe-kube-api-access-jvrnw\") pod \"node-resolver-62ddv\" (UID: \"b0baf25a-1695-4bef-8be0-42ac37b5d7fe\") " pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.050995 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051014 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-run\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051023 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-cni-binary-copy\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.051057 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs podName:6dd258db-1cff-4db7-a043-b3505b84dfb7 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:56.551043698 +0000 UTC m=+4.696968852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs") pod "network-metrics-daemon-l2wd2" (UID: "6dd258db-1cff-4db7-a043-b3505b84dfb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051067 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fda8510-3a22-4893-85e3-6f8d335a90bd-serviceca\") pod \"node-ca-9l9j6\" (UID: \"8fda8510-3a22-4893-85e3-6f8d335a90bd\") " pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051080 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-kubelet\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051100 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwxtz\" (UniqueName: \"kubernetes.io/projected/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-kube-api-access-hwxtz\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051236 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgsr5\" (UniqueName: \"kubernetes.io/projected/54947b01-7381-4b3b-9b6a-768c4b771671-kube-api-access-kgsr5\") pod \"iptables-alerter-8624r\" (UID: \"54947b01-7381-4b3b-9b6a-768c4b771671\") " pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051352 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0baf25a-1695-4bef-8be0-42ac37b5d7fe-tmp-dir\") pod \"node-resolver-62ddv\" (UID: \"b0baf25a-1695-4bef-8be0-42ac37b5d7fe\") " pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051388 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-run-netns\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-sysconfig\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051468 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skp64\" (UniqueName: \"kubernetes.io/projected/970df45c-7b47-4c5d-ab8b-95daf1604734-kube-api-access-skp64\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.052113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051496 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-systemd-units\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-etc-openvswitch\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051556 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-run-ovn\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8078e46-08b4-42dc-b26c-4c641ead8339-konnectivity-ca\") pod \"konnectivity-agent-6tjqt\" (UID: \"e8078e46-08b4-42dc-b26c-4c641ead8339\") " pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051642 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/449e669f-ccb6-4110-ac97-c540212b87ed-multus-daemon-config\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-tuned\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-slash\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051756 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-node-log\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051781 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/557e8783-4dae-46ee-be7e-90e81efe69d7-kubelet-config\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051800 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/54947b01-7381-4b3b-9b6a-768c4b771671-iptables-alerter-script\") pod \"iptables-alerter-8624r\" (UID: \"54947b01-7381-4b3b-9b6a-768c4b771671\") " pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.051881 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/557e8783-4dae-46ee-be7e-90e81efe69d7-kubelet-config\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:56.052861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.052138 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8078e46-08b4-42dc-b26c-4c641ead8339-konnectivity-ca\") pod \"konnectivity-agent-6tjqt\" (UID: \"e8078e46-08b4-42dc-b26c-4c641ead8339\") " pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:56:56.054559 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.054520 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8078e46-08b4-42dc-b26c-4c641ead8339-agent-certs\") pod \"konnectivity-agent-6tjqt\" (UID: \"e8078e46-08b4-42dc-b26c-4c641ead8339\") " pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:56:56.067118 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.067084 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:56:56.067118 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.067119 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:56:56.067350 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.067134 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6nh2q for pod openshift-network-diagnostics/network-check-target-nqzkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:56:56.067350 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.067219 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q podName:eb1b686e-ca96-4296-8060-b1ecda60929d nodeName:}" failed. No retries permitted until 2026-09-17 17:56:56.567196234 +0000 UTC m=+4.713121390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6nh2q" (UniqueName: "kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q") pod "network-check-target-nqzkc" (UID: "eb1b686e-ca96-4296-8060-b1ecda60929d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:56:56.069787 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.069713 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dx4s\" (UniqueName: \"kubernetes.io/projected/ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec-kube-api-access-7dx4s\") pod \"aws-ebs-csi-driver-node-5sx4z\" (UID: \"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.070594 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.070277 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkwdb\" (UniqueName: \"kubernetes.io/projected/8fda8510-3a22-4893-85e3-6f8d335a90bd-kube-api-access-fkwdb\") pod \"node-ca-9l9j6\" (UID: \"8fda8510-3a22-4893-85e3-6f8d335a90bd\") " pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:56.070594 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.070524 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgsr5\" (UniqueName: \"kubernetes.io/projected/54947b01-7381-4b3b-9b6a-768c4b771671-kube-api-access-kgsr5\") pod \"iptables-alerter-8624r\" (UID: \"54947b01-7381-4b3b-9b6a-768c4b771671\") " pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:56.071858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.071812 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrlbg\" (UniqueName: \"kubernetes.io/projected/91a5d860-8eb5-4edf-bd3f-00a9cc80c43d-kube-api-access-hrlbg\") pod \"multus-additional-cni-plugins-8v98r\" (UID: \"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d\") " pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.073054 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.073032 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkp5z\" (UniqueName: \"kubernetes.io/projected/6dd258db-1cff-4db7-a043-b3505b84dfb7-kube-api-access-lkp5z\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:56.083607 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.083538 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" event={"ID":"04ddfa7d8805c056a864c45acb85b2eb","Type":"ContainerStarted","Data":"6db74678c8034b2fbd72de3d440dd001ad0eeaf286c1c7d7d75a4ef2f8e885f4"} Sep 17 17:56:56.085167 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.085121 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"507a24b2ffe92f3b87cfca5c4f26c0f5","Type":"ContainerStarted","Data":"d3bc31c75e216ab13395fa14073317dfc82e9f21ca47d8e8102303df23cea78e"} Sep 17 17:56:56.152326 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152285 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-multus-cni-dir\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152326 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152335 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-ovnkube-script-lib\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-kubernetes\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-lib-modules\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152414 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-run-netns\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152436 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152435 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-multus-cni-dir\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152511 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152528 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-run-netns\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152530 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-kubernetes\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152559 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-lib-modules\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.152600 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152538 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-ovnkube-config\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-system-cni-dir\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-cnibin\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-var-lib-cni-bin\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-var-lib-kubelet\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152776 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-cnibin\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152789 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-systemd\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152806 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-system-cni-dir\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152814 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-hostroot\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152777 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-var-lib-cni-bin\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152829 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-systemd\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152816 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-var-lib-kubelet\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152852 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-hostroot\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152860 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-host\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152881 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-log-socket\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.152998 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152932 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-log-socket\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153033 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-ovnkube-config\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153041 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-ovnkube-script-lib\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153045 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-multus-socket-dir-parent\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.152899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-multus-socket-dir-parent\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153410 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-host\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-cni-netd\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153456 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-sysctl-conf\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153463 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-cni-netd\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153480 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-run-multus-certs\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153501 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpmm7\" (UniqueName: \"kubernetes.io/projected/449e669f-ccb6-4110-ac97-c540212b87ed-kube-api-access-qpmm7\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153553 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-cni-bin\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/449e669f-ccb6-4110-ac97-c540212b87ed-cni-binary-copy\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.153612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-etc-kubernetes\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153635 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-var-lib-cni-multus\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153639 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-cni-bin\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153647 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-sysctl-conf\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153588 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-run-multus-certs\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-run-ovn-kubernetes\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153689 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0baf25a-1695-4bef-8be0-42ac37b5d7fe-hosts-file\") pod \"node-resolver-62ddv\" (UID: \"b0baf25a-1695-4bef-8be0-42ac37b5d7fe\") " pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153698 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-etc-kubernetes\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvrnw\" (UniqueName: \"kubernetes.io/projected/b0baf25a-1695-4bef-8be0-42ac37b5d7fe-kube-api-access-jvrnw\") pod \"node-resolver-62ddv\" (UID: \"b0baf25a-1695-4bef-8be0-42ac37b5d7fe\") " pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153731 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-var-lib-cni-multus\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-run\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153755 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-run-ovn-kubernetes\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153746 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0baf25a-1695-4bef-8be0-42ac37b5d7fe-hosts-file\") pod \"node-resolver-62ddv\" (UID: \"b0baf25a-1695-4bef-8be0-42ac37b5d7fe\") " pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-kubelet\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-run\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153815 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwxtz\" (UniqueName: \"kubernetes.io/projected/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-kube-api-access-hwxtz\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153832 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-kubelet\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0baf25a-1695-4bef-8be0-42ac37b5d7fe-tmp-dir\") pod \"node-resolver-62ddv\" (UID: \"b0baf25a-1695-4bef-8be0-42ac37b5d7fe\") " pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.154164 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153907 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-run-netns\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-sysconfig\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skp64\" (UniqueName: \"kubernetes.io/projected/970df45c-7b47-4c5d-ab8b-95daf1604734-kube-api-access-skp64\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.153985 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-systemd-units\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.154016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-etc-openvswitch\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.154032 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-sysconfig\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.154487 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-etc-openvswitch\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.154561 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-systemd-units\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.154793 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/449e669f-ccb6-4110-ac97-c540212b87ed-cni-binary-copy\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.154852 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-run-netns\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.154967 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0baf25a-1695-4bef-8be0-42ac37b5d7fe-tmp-dir\") pod \"node-resolver-62ddv\" (UID: \"b0baf25a-1695-4bef-8be0-42ac37b5d7fe\") " pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.154996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.154988 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-run-ovn\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.155510 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/449e669f-ccb6-4110-ac97-c540212b87ed-multus-daemon-config\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.155566 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155533 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/449e669f-ccb6-4110-ac97-c540212b87ed-multus-daemon-config\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.155640 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155623 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-run-ovn\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.155702 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155665 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-tuned\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.155754 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155700 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-slash\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.155754 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155727 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-node-log\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.155854 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-run-k8s-cni-cncf-io\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.155854 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155806 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-var-lib-kubelet\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.155949 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155839 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-run-systemd\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.155949 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-modprobe-d\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.155949 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-run-openvswitch\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.156091 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.155970 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-ovn-node-metrics-cert\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.156091 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.156000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-multus-conf-dir\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.156091 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.156031 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-sysctl-d\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.156091 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.156061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-sys\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.156262 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.156090 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970df45c-7b47-4c5d-ab8b-95daf1604734-tmp\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.156262 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.156123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-var-lib-openvswitch\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.156262 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.156155 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-env-overrides\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.156823 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.156594 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-env-overrides\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.157187 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.156996 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-run-openvswitch\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.157187 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157068 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-host-slash\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.157187 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157118 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-node-log\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.157471 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157167 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-host-run-k8s-cni-cncf-io\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.157604 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157247 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/449e669f-ccb6-4110-ac97-c540212b87ed-multus-conf-dir\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.157604 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157291 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-sys\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.157604 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157398 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-modprobe-d\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.157778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157628 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-run-systemd\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.157778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157683 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-var-lib-kubelet\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.157778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157757 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-var-lib-openvswitch\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.157923 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.157786 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-sysctl-d\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.159738 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.159707 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/970df45c-7b47-4c5d-ab8b-95daf1604734-etc-tuned\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.159864 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.159830 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-ovn-node-metrics-cert\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.160204 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.160185 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/970df45c-7b47-4c5d-ab8b-95daf1604734-tmp\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.165241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.165216 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvrnw\" (UniqueName: \"kubernetes.io/projected/b0baf25a-1695-4bef-8be0-42ac37b5d7fe-kube-api-access-jvrnw\") pod \"node-resolver-62ddv\" (UID: \"b0baf25a-1695-4bef-8be0-42ac37b5d7fe\") " pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.165534 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.165507 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpmm7\" (UniqueName: \"kubernetes.io/projected/449e669f-ccb6-4110-ac97-c540212b87ed-kube-api-access-qpmm7\") pod \"multus-f6bj5\" (UID: \"449e669f-ccb6-4110-ac97-c540212b87ed\") " pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.166661 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.166640 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skp64\" (UniqueName: \"kubernetes.io/projected/970df45c-7b47-4c5d-ab8b-95daf1604734-kube-api-access-skp64\") pod \"tuned-p6nzs\" (UID: \"970df45c-7b47-4c5d-ab8b-95daf1604734\") " pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.167191 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.167167 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwxtz\" (UniqueName: \"kubernetes.io/projected/a7242ee7-5eb4-4b53-97af-f6f84dc3374d-kube-api-access-hwxtz\") pod \"ovnkube-node-8lhr7\" (UID: \"a7242ee7-5eb4-4b53-97af-f6f84dc3374d\") " pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.237695 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.237655 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8624r" Sep 17 17:56:56.245214 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.245186 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" Sep 17 17:56:56.261303 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.261208 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8v98r" Sep 17 17:56:56.270303 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.270266 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9l9j6" Sep 17 17:56:56.278283 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.278259 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:56:56.286043 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.286021 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-62ddv" Sep 17 17:56:56.293698 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.293676 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f6bj5" Sep 17 17:56:56.301343 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.301321 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" Sep 17 17:56:56.308384 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.308362 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:56:56.559854 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.559753 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:56.559854 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.559842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:56.560082 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.559932 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:56:56.560082 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.559958 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:56:56.560082 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.560015 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret podName:557e8783-4dae-46ee-be7e-90e81efe69d7 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:57.559991539 +0000 UTC m=+5.705916714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret") pod "global-pull-secret-syncer-gds4r" (UID: "557e8783-4dae-46ee-be7e-90e81efe69d7") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:56:56.560082 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.560033 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs podName:6dd258db-1cff-4db7-a043-b3505b84dfb7 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:57.560024643 +0000 UTC m=+5.705949812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs") pod "network-metrics-daemon-l2wd2" (UID: "6dd258db-1cff-4db7-a043-b3505b84dfb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:56:56.661135 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:56.661093 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:56:56.661345 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.661267 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:56:56.661345 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.661288 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:56:56.661345 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.661297 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6nh2q for pod openshift-network-diagnostics/network-check-target-nqzkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:56:56.661495 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:56.661360 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q podName:eb1b686e-ca96-4296-8060-b1ecda60929d nodeName:}" failed. No retries permitted until 2026-09-17 17:56:57.661345008 +0000 UTC m=+5.807270162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nh2q" (UniqueName: "kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q") pod "network-check-target-nqzkc" (UID: "eb1b686e-ca96-4296-8060-b1ecda60929d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:56:56.986725 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:56.986687 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54947b01_7381_4b3b_9b6a_768c4b771671.slice/crio-e2a2166033b134313dd21ee5653db2a45592249c0ef0cbec04a389e1d80f37cb WatchSource:0}: Error finding container e2a2166033b134313dd21ee5653db2a45592249c0ef0cbec04a389e1d80f37cb: Status 404 returned error can't find the container with id e2a2166033b134313dd21ee5653db2a45592249c0ef0cbec04a389e1d80f37cb Sep 17 17:56:56.988998 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:56.988721 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a5d860_8eb5_4edf_bd3f_00a9cc80c43d.slice/crio-57c81516792e22a66033be710decbb03f7930d4ff8b617fa084f060b4bcdcd50 WatchSource:0}: Error finding container 57c81516792e22a66033be710decbb03f7930d4ff8b617fa084f060b4bcdcd50: Status 404 returned error can't find the container with id 57c81516792e22a66033be710decbb03f7930d4ff8b617fa084f060b4bcdcd50 Sep 17 17:56:56.993392 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:56.992888 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0baf25a_1695_4bef_8be0_42ac37b5d7fe.slice/crio-0721d0fbe89d4976c220d432b5bd42469bf410e0f79ba368436db3c9a99fb29c WatchSource:0}: Error finding container 0721d0fbe89d4976c220d432b5bd42469bf410e0f79ba368436db3c9a99fb29c: Status 404 returned error can't find the container with id 0721d0fbe89d4976c220d432b5bd42469bf410e0f79ba368436db3c9a99fb29c Sep 17 17:56:56.993911 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:56.993888 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fda8510_3a22_4893_85e3_6f8d335a90bd.slice/crio-08961f9bc0b1fe9524682ae6f93ffe9128e9f959ab3e307d22f850233117e0e5 WatchSource:0}: Error finding container 08961f9bc0b1fe9524682ae6f93ffe9128e9f959ab3e307d22f850233117e0e5: Status 404 returned error can't find the container with id 08961f9bc0b1fe9524682ae6f93ffe9128e9f959ab3e307d22f850233117e0e5 Sep 17 17:56:56.995347 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:56.995320 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8078e46_08b4_42dc_b26c_4c641ead8339.slice/crio-3c2e6fbf225613f794807f469843d3db6962904497c4cc8928859adcf0805bcf WatchSource:0}: Error finding container 3c2e6fbf225613f794807f469843d3db6962904497c4cc8928859adcf0805bcf: Status 404 returned error can't find the container with id 3c2e6fbf225613f794807f469843d3db6962904497c4cc8928859adcf0805bcf Sep 17 17:56:56.997069 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:56.996144 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970df45c_7b47_4c5d_ab8b_95daf1604734.slice/crio-d7faa135dcaa017a44f1a9d372d5b6a2795fb8b7f36a441b69961090eff903ce WatchSource:0}: Error finding container d7faa135dcaa017a44f1a9d372d5b6a2795fb8b7f36a441b69961090eff903ce: Status 404 returned error can't find the container with id d7faa135dcaa017a44f1a9d372d5b6a2795fb8b7f36a441b69961090eff903ce Sep 17 17:56:56.997685 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:56.997663 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec68375f_a3c2_4a3f_90c6_abe3b0ce0dec.slice/crio-456ab1219580a671b69eb9287b13fd0b1eb3afd062335042fa9985a0e90fdc74 WatchSource:0}: Error finding container 456ab1219580a671b69eb9287b13fd0b1eb3afd062335042fa9985a0e90fdc74: Status 404 returned error can't find the container with id 456ab1219580a671b69eb9287b13fd0b1eb3afd062335042fa9985a0e90fdc74 Sep 17 17:56:56.999781 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:56.999746 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7242ee7_5eb4_4b53_97af_f6f84dc3374d.slice/crio-acbabb6a21208cbe96dcd333ecfd86c30fdf41a748fea8ef6b8bfecafed4f0fe WatchSource:0}: Error finding container acbabb6a21208cbe96dcd333ecfd86c30fdf41a748fea8ef6b8bfecafed4f0fe: Status 404 returned error can't find the container with id acbabb6a21208cbe96dcd333ecfd86c30fdf41a748fea8ef6b8bfecafed4f0fe Sep 17 17:56:57.001354 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:56:57.000458 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449e669f_ccb6_4110_ac97_c540212b87ed.slice/crio-92dc816ba0f66fcfc9663a9e2b38b7c5da190b4df0fbd9b48b26359dfc05343b WatchSource:0}: Error finding container 92dc816ba0f66fcfc9663a9e2b38b7c5da190b4df0fbd9b48b26359dfc05343b: Status 404 returned error can't find the container with id 92dc816ba0f66fcfc9663a9e2b38b7c5da190b4df0fbd9b48b26359dfc05343b Sep 17 17:56:57.051914 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.051875 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:51:56 +0000 UTC" deadline="2028-05-10 13:59:19.2742189 +0000 UTC" Sep 17 17:56:57.051914 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.051913 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14420h2m22.222310796s" Sep 17 17:56:57.088860 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.088823 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8624r" event={"ID":"54947b01-7381-4b3b-9b6a-768c4b771671","Type":"ContainerStarted","Data":"e2a2166033b134313dd21ee5653db2a45592249c0ef0cbec04a389e1d80f37cb"} Sep 17 17:56:57.091041 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.090982 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" event={"ID":"04ddfa7d8805c056a864c45acb85b2eb","Type":"ContainerStarted","Data":"7760f1803c80483417c8acb0a455a981209976cbec30b81eb044ac312cc354e4"} Sep 17 17:56:57.092249 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.092221 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f6bj5" event={"ID":"449e669f-ccb6-4110-ac97-c540212b87ed","Type":"ContainerStarted","Data":"92dc816ba0f66fcfc9663a9e2b38b7c5da190b4df0fbd9b48b26359dfc05343b"} Sep 17 17:56:57.093457 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.093434 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" event={"ID":"a7242ee7-5eb4-4b53-97af-f6f84dc3374d","Type":"ContainerStarted","Data":"acbabb6a21208cbe96dcd333ecfd86c30fdf41a748fea8ef6b8bfecafed4f0fe"} Sep 17 17:56:57.094813 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.094786 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" event={"ID":"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec","Type":"ContainerStarted","Data":"456ab1219580a671b69eb9287b13fd0b1eb3afd062335042fa9985a0e90fdc74"} Sep 17 17:56:57.095949 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.095928 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-62ddv" event={"ID":"b0baf25a-1695-4bef-8be0-42ac37b5d7fe","Type":"ContainerStarted","Data":"0721d0fbe89d4976c220d432b5bd42469bf410e0f79ba368436db3c9a99fb29c"} Sep 17 17:56:57.097272 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.097242 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" event={"ID":"970df45c-7b47-4c5d-ab8b-95daf1604734","Type":"ContainerStarted","Data":"d7faa135dcaa017a44f1a9d372d5b6a2795fb8b7f36a441b69961090eff903ce"} Sep 17 17:56:57.098463 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.098439 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6tjqt" event={"ID":"e8078e46-08b4-42dc-b26c-4c641ead8339","Type":"ContainerStarted","Data":"3c2e6fbf225613f794807f469843d3db6962904497c4cc8928859adcf0805bcf"} Sep 17 17:56:57.099747 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.099707 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9l9j6" event={"ID":"8fda8510-3a22-4893-85e3-6f8d335a90bd","Type":"ContainerStarted","Data":"08961f9bc0b1fe9524682ae6f93ffe9128e9f959ab3e307d22f850233117e0e5"} Sep 17 17:56:57.100875 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.100854 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v98r" event={"ID":"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d","Type":"ContainerStarted","Data":"57c81516792e22a66033be710decbb03f7930d4ff8b617fa084f060b4bcdcd50"} Sep 17 17:56:57.106454 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.106392 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" podStartSLOduration=2.106377111 podStartE2EDuration="2.106377111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:56:57.105944234 +0000 UTC m=+5.251869433" watchObservedRunningTime="2026-09-17 17:56:57.106377111 +0000 UTC m=+5.252302289" Sep 17 17:56:57.569558 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.569237 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:57.569746 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.569597 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:57.569746 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:57.569385 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:56:57.569854 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:57.569795 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs podName:6dd258db-1cff-4db7-a043-b3505b84dfb7 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:59.569775425 +0000 UTC m=+7.715700600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs") pod "network-metrics-daemon-l2wd2" (UID: "6dd258db-1cff-4db7-a043-b3505b84dfb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:56:57.570273 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:57.569728 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:56:57.570393 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:57.570317 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret podName:557e8783-4dae-46ee-be7e-90e81efe69d7 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:59.570297903 +0000 UTC m=+7.716223062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret") pod "global-pull-secret-syncer-gds4r" (UID: "557e8783-4dae-46ee-be7e-90e81efe69d7") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:56:57.670858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:57.670198 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:56:57.670858 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:57.670389 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:56:57.670858 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:57.670414 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:56:57.670858 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:57.670426 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6nh2q for pod openshift-network-diagnostics/network-check-target-nqzkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:56:57.670858 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:57.670487 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q podName:eb1b686e-ca96-4296-8060-b1ecda60929d nodeName:}" failed. No retries permitted until 2026-09-17 17:56:59.670467272 +0000 UTC m=+7.816392443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nh2q" (UniqueName: "kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q") pod "network-check-target-nqzkc" (UID: "eb1b686e-ca96-4296-8060-b1ecda60929d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:56:58.053183 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:58.053097 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:51:56 +0000 UTC" deadline="2028-04-29 13:37:23.992017162 +0000 UTC" Sep 17 17:56:58.053183 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:58.053159 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14155h40m25.938862008s" Sep 17 17:56:58.085841 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:58.085076 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:58.085841 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:58.085208 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:56:58.085841 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:58.085620 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:56:58.085841 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:58.085707 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:56:58.085841 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:58.085764 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:58.085841 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:58.085831 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:56:58.128482 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:58.128436 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"507a24b2ffe92f3b87cfca5c4f26c0f5","Type":"ContainerDied","Data":"f9f6ee0a00dfaa50c46202ac1a9194302f1a3e261fefa4041a3e92d848f71485"} Sep 17 17:56:58.129785 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:58.128805 2582 generic.go:356] "Generic (PLEG): container finished" podID="507a24b2ffe92f3b87cfca5c4f26c0f5" containerID="f9f6ee0a00dfaa50c46202ac1a9194302f1a3e261fefa4041a3e92d848f71485" exitCode=0 Sep 17 17:56:59.149826 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:59.149778 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"507a24b2ffe92f3b87cfca5c4f26c0f5","Type":"ContainerStarted","Data":"de6eaa9fa5bed2c5996fcba80e1e1689adbce93ca836cbd6fa211da2d37b2e6c"} Sep 17 17:56:59.591238 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:59.590382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:56:59.591238 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:59.590463 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:56:59.591238 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:59.590620 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:56:59.591238 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:59.590687 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs podName:6dd258db-1cff-4db7-a043-b3505b84dfb7 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:03.590665175 +0000 UTC m=+11.736590347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs") pod "network-metrics-daemon-l2wd2" (UID: "6dd258db-1cff-4db7-a043-b3505b84dfb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:56:59.591238 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:59.591101 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:56:59.591238 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:59.591151 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret podName:557e8783-4dae-46ee-be7e-90e81efe69d7 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:03.591136395 +0000 UTC m=+11.737061549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret") pod "global-pull-secret-syncer-gds4r" (UID: "557e8783-4dae-46ee-be7e-90e81efe69d7") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:56:59.692057 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:56:59.691292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:56:59.692057 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:59.691495 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:56:59.692057 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:59.691517 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:56:59.692057 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:59.691546 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6nh2q for pod openshift-network-diagnostics/network-check-target-nqzkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:56:59.692057 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:56:59.691621 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q podName:eb1b686e-ca96-4296-8060-b1ecda60929d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:03.691601536 +0000 UTC m=+11.837526704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nh2q" (UniqueName: "kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q") pod "network-check-target-nqzkc" (UID: "eb1b686e-ca96-4296-8060-b1ecda60929d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:57:00.083265 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:00.082525 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:00.083265 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:00.082662 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:00.083265 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:00.083023 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:00.083265 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:00.083125 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:00.083265 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:00.083167 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:00.083265 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:00.083226 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:02.082597 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:02.082553 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:02.083045 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:02.082554 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:02.083045 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:02.082716 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:02.083045 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:02.082748 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:02.083045 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:02.082557 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:02.083045 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:02.082863 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:03.626246 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:03.626204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:03.626707 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:03.626292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:03.626707 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:03.626373 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:57:03.626707 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:03.626402 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:57:03.626707 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:03.626450 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret podName:557e8783-4dae-46ee-be7e-90e81efe69d7 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:11.626429265 +0000 UTC m=+19.772354433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret") pod "global-pull-secret-syncer-gds4r" (UID: "557e8783-4dae-46ee-be7e-90e81efe69d7") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:57:03.626707 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:03.626471 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs podName:6dd258db-1cff-4db7-a043-b3505b84dfb7 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:11.626460798 +0000 UTC m=+19.772385965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs") pod "network-metrics-daemon-l2wd2" (UID: "6dd258db-1cff-4db7-a043-b3505b84dfb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:57:03.727269 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:03.727227 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:03.727474 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:03.727425 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:57:03.727474 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:03.727448 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:57:03.727474 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:03.727461 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6nh2q for pod openshift-network-diagnostics/network-check-target-nqzkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:57:03.727632 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:03.727519 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q podName:eb1b686e-ca96-4296-8060-b1ecda60929d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:11.727500621 +0000 UTC m=+19.873425777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nh2q" (UniqueName: "kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q") pod "network-check-target-nqzkc" (UID: "eb1b686e-ca96-4296-8060-b1ecda60929d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:57:04.079490 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:04.079358 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:04.079490 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:04.079461 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:04.079764 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:04.079494 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:04.079764 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:04.079589 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:04.079764 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:04.079589 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:04.079764 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:04.079696 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:06.078714 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:06.078682 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:06.078714 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:06.078696 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:06.079234 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:06.078819 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:06.079234 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:06.078870 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:06.079234 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:06.079002 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:06.079234 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:06.079107 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:08.077885 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:08.077849 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:08.078357 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:08.077849 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:08.078357 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:08.077984 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:08.078357 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:08.077849 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:08.078357 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:08.078075 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:08.078357 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:08.078152 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:10.078522 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:10.078483 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:10.079052 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:10.078483 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:10.079052 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:10.078611 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:10.079052 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:10.078718 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:10.079052 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:10.078495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:10.079052 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:10.078838 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:11.690557 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:11.690512 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:11.691016 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:11.690602 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:11.691016 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:11.690692 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:57:11.691016 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:11.690721 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:57:11.691016 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:11.690774 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret podName:557e8783-4dae-46ee-be7e-90e81efe69d7 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:27.690754839 +0000 UTC m=+35.836679996 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret") pod "global-pull-secret-syncer-gds4r" (UID: "557e8783-4dae-46ee-be7e-90e81efe69d7") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:57:11.691016 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:11.690795 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs podName:6dd258db-1cff-4db7-a043-b3505b84dfb7 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:27.690785101 +0000 UTC m=+35.836710271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs") pod "network-metrics-daemon-l2wd2" (UID: "6dd258db-1cff-4db7-a043-b3505b84dfb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:57:11.791615 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:11.791548 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:11.791789 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:11.791757 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:57:11.791789 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:11.791783 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:57:11.791869 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:11.791796 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6nh2q for pod openshift-network-diagnostics/network-check-target-nqzkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:57:11.791869 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:11.791862 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q podName:eb1b686e-ca96-4296-8060-b1ecda60929d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:27.791843958 +0000 UTC m=+35.937769114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nh2q" (UniqueName: "kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q") pod "network-check-target-nqzkc" (UID: "eb1b686e-ca96-4296-8060-b1ecda60929d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:57:12.078445 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:12.078365 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:12.078624 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:12.078367 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:12.078624 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:12.078504 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:12.078624 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:12.078367 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:12.078624 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:12.078593 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:12.078820 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:12.078638 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:14.079004 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:14.078967 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:14.079494 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:14.079058 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:14.079494 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:14.079129 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:14.079494 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:14.079217 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:14.079494 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:14.079258 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:14.079494 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:14.079313 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:15.186248 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.186013 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" event={"ID":"970df45c-7b47-4c5d-ab8b-95daf1604734","Type":"ContainerStarted","Data":"add0c9a296b3e4ede7e0045902b42cfbbdc1886914058ecc5efceb0ad18f740d"} Sep 17 17:57:15.188188 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.187949 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6tjqt" event={"ID":"e8078e46-08b4-42dc-b26c-4c641ead8339","Type":"ContainerStarted","Data":"24819114261c823e7ad7e7a0eaf69c7a4336976d50ca336904b639ad3ba1da08"} Sep 17 17:57:15.189684 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.189648 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9l9j6" event={"ID":"8fda8510-3a22-4893-85e3-6f8d335a90bd","Type":"ContainerStarted","Data":"d61eef4193bd775bff051482da7179c7ff43a73e845e5e9965eb1c303cc67a9b"} Sep 17 17:57:15.191343 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.191299 2582 generic.go:356] "Generic (PLEG): container finished" podID="91a5d860-8eb5-4edf-bd3f-00a9cc80c43d" containerID="c49ef36488e7314fc3d6611098e687e7bc5deffb8fca03dd3485ad701e332fed" exitCode=0 Sep 17 17:57:15.191468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.191338 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v98r" event={"ID":"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d","Type":"ContainerDied","Data":"c49ef36488e7314fc3d6611098e687e7bc5deffb8fca03dd3485ad701e332fed"} Sep 17 17:57:15.193307 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.193272 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f6bj5" event={"ID":"449e669f-ccb6-4110-ac97-c540212b87ed","Type":"ContainerStarted","Data":"ab8beb7a5f1f5af2fd6ba7e506fe60d6a1efe2c2686cdd4348e8284e6b05a552"} Sep 17 17:57:15.199646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.197867 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" event={"ID":"a7242ee7-5eb4-4b53-97af-f6f84dc3374d","Type":"ContainerStarted","Data":"afc565a4d939473e12e4af882a89ce22c938c25b064b8c3826dbafa10b1cf4e6"} Sep 17 17:57:15.199646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.197986 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" event={"ID":"a7242ee7-5eb4-4b53-97af-f6f84dc3374d","Type":"ContainerStarted","Data":"bc01a1fa6c4b436131ec275360880b6e893de1c4e9fdb3ee0e5fb5b41d0179c5"} Sep 17 17:57:15.199646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.198051 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" event={"ID":"a7242ee7-5eb4-4b53-97af-f6f84dc3374d","Type":"ContainerStarted","Data":"1b20e67d006ee8065b82e4c2d3851db1dc57287b1a2846161fd7bd51b4d40c26"} Sep 17 17:57:15.199646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.198113 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" event={"ID":"a7242ee7-5eb4-4b53-97af-f6f84dc3374d","Type":"ContainerStarted","Data":"6b9c1fdea4c3bdf81e5e432cc2e302fb22a03212c1663cf3c5c71af56240340b"} Sep 17 17:57:15.199646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.198170 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" event={"ID":"a7242ee7-5eb4-4b53-97af-f6f84dc3374d","Type":"ContainerStarted","Data":"a2f2512899d5e117603f87cf3e0b85a9b7599b4a3f7abda224318f80e8fb3537"} Sep 17 17:57:15.199646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.198229 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" event={"ID":"a7242ee7-5eb4-4b53-97af-f6f84dc3374d","Type":"ContainerStarted","Data":"6e534c9d32196895bec2be8be31c8a3673eba568b1545d2fd82d7b6a44bcbc8d"} Sep 17 17:57:15.201613 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.201572 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" event={"ID":"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec","Type":"ContainerStarted","Data":"ad2be4a6af6d321dabb3cd6c5c53537895834a64eab28e02d00532fedbbcc9c1"} Sep 17 17:57:15.203066 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.203038 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-62ddv" event={"ID":"b0baf25a-1695-4bef-8be0-42ac37b5d7fe","Type":"ContainerStarted","Data":"dbcbf12582a18495c3e3cfe713824652f4a6e5b21482e726e3f75527c0ac166c"} Sep 17 17:57:15.220010 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.219904 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" podStartSLOduration=20.219885586 podStartE2EDuration="20.219885586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:56:59.169267557 +0000 UTC m=+7.315192754" watchObservedRunningTime="2026-09-17 17:57:15.219885586 +0000 UTC m=+23.365810763" Sep 17 17:57:15.250067 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.250005 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p6nzs" podStartSLOduration=3.758806154 podStartE2EDuration="21.249985245s" totalImagesPullingTime="17.491179091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:15.219727523 +0000 UTC m=+23.365652714" watchObservedRunningTime="2026-09-17 17:57:15.249985245 +0000 UTC m=+23.395910420" Sep 17 17:57:15.293899 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.293851 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9l9j6" podStartSLOduration=3.831487339 podStartE2EDuration="21.293831244s" totalImagesPullingTime="17.462343905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:15.271810258 +0000 UTC m=+23.417735444" watchObservedRunningTime="2026-09-17 17:57:15.293831244 +0000 UTC m=+23.439756422" Sep 17 17:57:15.327753 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.327689 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-62ddv" podStartSLOduration=3.8635777019999997 podStartE2EDuration="21.327669248s" totalImagesPullingTime="17.464091546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:15.327174501 +0000 UTC m=+23.473099696" watchObservedRunningTime="2026-09-17 17:57:15.327669248 +0000 UTC m=+23.473594425" Sep 17 17:57:15.328113 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.328086 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6tjqt" podStartSLOduration=11.373255183 podStartE2EDuration="21.328075999s" totalImagesPullingTime="9.954820816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:15.293918705 +0000 UTC m=+23.439843880" watchObservedRunningTime="2026-09-17 17:57:15.328075999 +0000 UTC m=+23.474001178" Sep 17 17:57:15.352609 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.352541 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f6bj5" podStartSLOduration=3.80671638 podStartE2EDuration="21.352520541s" totalImagesPullingTime="17.545804161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:15.352196346 +0000 UTC m=+23.498121522" watchObservedRunningTime="2026-09-17 17:57:15.352520541 +0000 UTC m=+23.498445717" Sep 17 17:57:15.582170 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:15.582138 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 17:57:16.033081 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:16.032974 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:57:15.582162134Z","UUID":"111a920d-ebaf-41d4-982e-8fb18b42d296","Handler":null,"Name":"","Endpoint":""} Sep 17 17:57:16.035372 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:16.035133 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 17:57:16.035372 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:16.035170 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 17:57:16.078813 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:16.078776 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:16.079009 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:16.078776 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:16.079009 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:16.078899 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:16.079009 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:16.078914 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:16.079009 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:16.078983 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:16.079230 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:16.079055 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:16.207943 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:16.207895 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8624r" event={"ID":"54947b01-7381-4b3b-9b6a-768c4b771671","Type":"ContainerStarted","Data":"88a406a01898af82a9b15d742ae9bd0574918c97fcc5281a0a6013d8d1d1bde9"} Sep 17 17:57:16.210067 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:16.210036 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" event={"ID":"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec","Type":"ContainerStarted","Data":"c20dd34709bd9cf907eea49cb1fa74e4a50be3c9cb3e51b9c3ff21c3e491fa72"} Sep 17 17:57:16.226015 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:16.225867 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8624r" podStartSLOduration=4.757081922 podStartE2EDuration="22.225842854s" totalImagesPullingTime="17.468760932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:16.225141103 +0000 UTC m=+24.371066280" watchObservedRunningTime="2026-09-17 17:57:16.225842854 +0000 UTC m=+24.371768034" Sep 17 17:57:17.216793 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:17.216753 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" event={"ID":"a7242ee7-5eb4-4b53-97af-f6f84dc3374d","Type":"ContainerStarted","Data":"f7728546d872d22c43bf5a7fc54123f606bcd7ed48050c00e02b19ecb690fa75"} Sep 17 17:57:17.219208 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:17.219179 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" event={"ID":"ec68375f-a3c2-4a3f-90c6-abe3b0ce0dec","Type":"ContainerStarted","Data":"69d29cd044b1638df915754954b50c4bda34055a1f1823cfda1681acbd5d80ae"} Sep 17 17:57:18.078599 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:18.078547 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:18.078792 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:18.078547 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:18.078792 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:18.078694 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:18.078891 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:18.078792 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:18.078891 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:18.078548 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:18.078970 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:18.078927 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:19.697403 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:19.697196 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:57:19.698052 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:19.697754 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:57:19.715377 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:19.715293 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sx4z" podStartSLOduration=6.71081792 podStartE2EDuration="25.71527738s" totalImagesPullingTime="19.00445946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:17.243632152 +0000 UTC m=+25.389557400" watchObservedRunningTime="2026-09-17 17:57:19.71527738 +0000 UTC m=+27.861202556" Sep 17 17:57:19.963319 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:19.963286 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:57:19.963895 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:19.963878 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6tjqt" Sep 17 17:57:20.077948 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:20.077860 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:20.077948 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:20.077891 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:20.078332 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:20.077858 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:20.078332 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:20.077971 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:20.078332 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:20.078034 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:20.078332 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:20.078092 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:20.228155 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:20.228120 2582 generic.go:356] "Generic (PLEG): container finished" podID="91a5d860-8eb5-4edf-bd3f-00a9cc80c43d" containerID="4fa6e3d3c4ba99c601e9354a3ffa04c0e93c045e3ab7094bdc3304a42be7bc71" exitCode=0 Sep 17 17:57:20.228319 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:20.228209 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v98r" event={"ID":"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d","Type":"ContainerDied","Data":"4fa6e3d3c4ba99c601e9354a3ffa04c0e93c045e3ab7094bdc3304a42be7bc71"} Sep 17 17:57:20.232303 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:20.232274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" event={"ID":"a7242ee7-5eb4-4b53-97af-f6f84dc3374d","Type":"ContainerStarted","Data":"1d3f05f8adb7b8bd1bd7a1727d05b26a209b19df68c98a49c8dbb3ce66aa6c0a"} Sep 17 17:57:20.293237 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:20.293180 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" podStartSLOduration=8.789734601 podStartE2EDuration="26.293163988s" totalImagesPullingTime="17.503429387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:20.293076561 +0000 UTC m=+28.439001762" watchObservedRunningTime="2026-09-17 17:57:20.293163988 +0000 UTC m=+28.439089163" Sep 17 17:57:21.235144 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.235119 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:57:21.235547 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.235193 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:57:21.235547 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.235226 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:57:21.251044 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.251008 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gds4r"] Sep 17 17:57:21.251260 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.251146 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:21.251320 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:21.251260 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:21.253612 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.253488 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:57:21.253713 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.253631 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:57:21.267378 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.267337 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nqzkc"] Sep 17 17:57:21.267505 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.267458 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:21.267603 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:21.267563 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:21.285358 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.285325 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l2wd2"] Sep 17 17:57:21.285516 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:21.285434 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:21.285624 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:21.285533 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:22.239436 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:22.239404 2582 generic.go:356] "Generic (PLEG): container finished" podID="91a5d860-8eb5-4edf-bd3f-00a9cc80c43d" containerID="75933fd51d79b87dfc47e4c98411381e679b7a39bcc59f8b5e3093f5ef0e5cd5" exitCode=0 Sep 17 17:57:22.239806 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:22.239488 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v98r" event={"ID":"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d","Type":"ContainerDied","Data":"75933fd51d79b87dfc47e4c98411381e679b7a39bcc59f8b5e3093f5ef0e5cd5"} Sep 17 17:57:23.077928 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:23.077889 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:23.078086 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:23.077892 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:23.078086 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:23.078000 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:23.078156 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:23.078085 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:23.078156 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:23.077893 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:23.078214 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:23.078166 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:24.245974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:24.245940 2582 generic.go:356] "Generic (PLEG): container finished" podID="91a5d860-8eb5-4edf-bd3f-00a9cc80c43d" containerID="bbd41d85043d75c19301dd5fe7339edb498cc6aeababba57b876d70f7dc4747c" exitCode=0 Sep 17 17:57:24.246515 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:24.245983 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v98r" event={"ID":"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d","Type":"ContainerDied","Data":"bbd41d85043d75c19301dd5fe7339edb498cc6aeababba57b876d70f7dc4747c"} Sep 17 17:57:25.077970 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:25.077937 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:25.078145 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:25.078004 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:25.078145 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:25.078011 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:25.078145 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:25.078094 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:25.078301 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:25.078170 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:25.078301 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:25.078230 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:27.077972 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.077936 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:27.078490 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.077986 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:27.078490 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.077986 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:27.078490 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.078066 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gds4r" podUID="557e8783-4dae-46ee-be7e-90e81efe69d7" Sep 17 17:57:27.078490 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.078181 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2wd2" podUID="6dd258db-1cff-4db7-a043-b3505b84dfb7" Sep 17 17:57:27.078490 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.078257 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nqzkc" podUID="eb1b686e-ca96-4296-8060-b1ecda60929d" Sep 17 17:57:27.360451 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.360372 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeReady" Sep 17 17:57:27.360621 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.360541 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 17:57:27.450947 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.450496 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5755p"] Sep 17 17:57:27.478013 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.477980 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vtwcr"] Sep 17 17:57:27.478181 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.478111 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5755p" Sep 17 17:57:27.481081 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.481052 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nvjd9\"" Sep 17 17:57:27.481207 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.481085 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 17:57:27.481357 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.481340 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 17:57:27.481700 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.481679 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 17:57:27.504021 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.503991 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5755p"] Sep 17 17:57:27.504137 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.504036 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vtwcr"] Sep 17 17:57:27.504137 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.504088 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.506151 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.506131 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqrn8\"" Sep 17 17:57:27.507396 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.507376 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 17:57:27.507655 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.507636 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 17:57:27.608251 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.608211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-tmp-dir\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.608251 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.608262 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.608526 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.608334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67baaaa3-da8b-46d9-9aeb-81d826aee966-cert\") pod \"ingress-canary-5755p\" (UID: \"67baaaa3-da8b-46d9-9aeb-81d826aee966\") " pod="openshift-ingress-canary/ingress-canary-5755p" Sep 17 17:57:27.608526 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.608391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-config-volume\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.608526 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.608432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvmm\" (UniqueName: \"kubernetes.io/projected/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-kube-api-access-hqvmm\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.608526 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.608469 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kqvx\" (UniqueName: \"kubernetes.io/projected/67baaaa3-da8b-46d9-9aeb-81d826aee966-kube-api-access-7kqvx\") pod \"ingress-canary-5755p\" (UID: \"67baaaa3-da8b-46d9-9aeb-81d826aee966\") " pod="openshift-ingress-canary/ingress-canary-5755p" Sep 17 17:57:27.709527 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.709483 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-config-volume\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.709527 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.709545 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvmm\" (UniqueName: \"kubernetes.io/projected/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-kube-api-access-hqvmm\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.709852 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.709819 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:27.709958 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.709874 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqvx\" (UniqueName: \"kubernetes.io/projected/67baaaa3-da8b-46d9-9aeb-81d826aee966-kube-api-access-7kqvx\") pod \"ingress-canary-5755p\" (UID: \"67baaaa3-da8b-46d9-9aeb-81d826aee966\") " pod="openshift-ingress-canary/ingress-canary-5755p" Sep 17 17:57:27.709958 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.709949 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:27.710067 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.709960 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:57:27.710067 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.709983 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-tmp-dir\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.710067 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.710010 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.710067 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.710031 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret podName:557e8783-4dae-46ee-be7e-90e81efe69d7 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:59.710011259 +0000 UTC m=+67.855936427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret") pod "global-pull-secret-syncer-gds4r" (UID: "557e8783-4dae-46ee-be7e-90e81efe69d7") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:57:27.710214 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.710067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67baaaa3-da8b-46d9-9aeb-81d826aee966-cert\") pod \"ingress-canary-5755p\" (UID: \"67baaaa3-da8b-46d9-9aeb-81d826aee966\") " pod="openshift-ingress-canary/ingress-canary-5755p" Sep 17 17:57:27.710214 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.710077 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:57:27.710214 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.710110 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls podName:7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:28.21010059 +0000 UTC m=+36.356025763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls") pod "dns-default-vtwcr" (UID: "7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d") : secret "dns-default-metrics-tls" not found Sep 17 17:57:27.710214 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.710159 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:57:27.710214 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.710199 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs podName:6dd258db-1cff-4db7-a043-b3505b84dfb7 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:59.710189706 +0000 UTC m=+67.856114874 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs") pod "network-metrics-daemon-l2wd2" (UID: "6dd258db-1cff-4db7-a043-b3505b84dfb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:57:27.710438 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.710247 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-config-volume\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.710534 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.710431 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-tmp-dir\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.715064 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.714920 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67baaaa3-da8b-46d9-9aeb-81d826aee966-cert\") pod \"ingress-canary-5755p\" (UID: \"67baaaa3-da8b-46d9-9aeb-81d826aee966\") " pod="openshift-ingress-canary/ingress-canary-5755p" Sep 17 17:57:27.722684 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.722661 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvmm\" (UniqueName: \"kubernetes.io/projected/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-kube-api-access-hqvmm\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:27.722804 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.722713 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kqvx\" (UniqueName: \"kubernetes.io/projected/67baaaa3-da8b-46d9-9aeb-81d826aee966-kube-api-access-7kqvx\") pod \"ingress-canary-5755p\" (UID: \"67baaaa3-da8b-46d9-9aeb-81d826aee966\") " pod="openshift-ingress-canary/ingress-canary-5755p" Sep 17 17:57:27.789266 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.789205 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5755p" Sep 17 17:57:27.810591 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:27.810541 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:27.810775 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.810698 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:57:27.810775 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.810720 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:57:27.810775 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.810731 2582 projected.go:196] Error preparing data for projected volume kube-api-access-6nh2q for pod openshift-network-diagnostics/network-check-target-nqzkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:57:27.810939 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:27.810794 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q podName:eb1b686e-ca96-4296-8060-b1ecda60929d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:59.810775335 +0000 UTC m=+67.956700505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nh2q" (UniqueName: "kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q") pod "network-check-target-nqzkc" (UID: "eb1b686e-ca96-4296-8060-b1ecda60929d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:57:28.212643 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:28.212608 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:28.213020 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:28.212721 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:57:28.213020 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:28.212790 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls podName:7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:29.212762006 +0000 UTC m=+37.358687160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls") pod "dns-default-vtwcr" (UID: "7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d") : secret "dns-default-metrics-tls" not found Sep 17 17:57:28.463635 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:28.463547 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5755p"] Sep 17 17:57:28.487335 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:57:28.487306 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67baaaa3_da8b_46d9_9aeb_81d826aee966.slice/crio-2b3a94ee90900cadf99752fd2cd08f14e4ad9dcd2a94d78f5dae1d133ea9d635 WatchSource:0}: Error finding container 2b3a94ee90900cadf99752fd2cd08f14e4ad9dcd2a94d78f5dae1d133ea9d635: Status 404 returned error can't find the container with id 2b3a94ee90900cadf99752fd2cd08f14e4ad9dcd2a94d78f5dae1d133ea9d635 Sep 17 17:57:29.078284 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.078200 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:29.078464 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.078200 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:29.078464 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.078200 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:29.080923 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.080897 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:57:29.081072 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.080964 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:57:29.081624 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.081417 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jm6gd\"" Sep 17 17:57:29.081624 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.081501 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:57:29.081624 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.081519 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7pjs\"" Sep 17 17:57:29.081624 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.081533 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:57:29.219985 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.219950 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:29.220789 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:29.220131 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:57:29.220789 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:29.220203 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls podName:7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:31.220183256 +0000 UTC m=+39.366108427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls") pod "dns-default-vtwcr" (UID: "7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d") : secret "dns-default-metrics-tls" not found Sep 17 17:57:29.262035 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.262001 2582 generic.go:356] "Generic (PLEG): container finished" podID="91a5d860-8eb5-4edf-bd3f-00a9cc80c43d" containerID="e4e4403ad6829d537d9c6c64b61d5c3f8a6a84a6871a1a2a87529f9807cbbfd1" exitCode=0 Sep 17 17:57:29.262200 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.262082 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v98r" event={"ID":"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d","Type":"ContainerDied","Data":"e4e4403ad6829d537d9c6c64b61d5c3f8a6a84a6871a1a2a87529f9807cbbfd1"} Sep 17 17:57:29.263448 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:29.263424 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5755p" event={"ID":"67baaaa3-da8b-46d9-9aeb-81d826aee966","Type":"ContainerStarted","Data":"2b3a94ee90900cadf99752fd2cd08f14e4ad9dcd2a94d78f5dae1d133ea9d635"} Sep 17 17:57:30.270475 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:30.270436 2582 generic.go:356] "Generic (PLEG): container finished" podID="91a5d860-8eb5-4edf-bd3f-00a9cc80c43d" containerID="e906ad357237233b22a997535ce75b1d7147c76d23ebe9ab9a5d2e3f44d8b621" exitCode=0 Sep 17 17:57:30.270965 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:30.270496 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v98r" event={"ID":"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d","Type":"ContainerDied","Data":"e906ad357237233b22a997535ce75b1d7147c76d23ebe9ab9a5d2e3f44d8b621"} Sep 17 17:57:31.235599 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:31.235395 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:31.235759 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:31.235505 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:57:31.235759 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:31.235690 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls podName:7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:35.235675325 +0000 UTC m=+43.381600479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls") pod "dns-default-vtwcr" (UID: "7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d") : secret "dns-default-metrics-tls" not found Sep 17 17:57:31.275750 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:31.275717 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v98r" event={"ID":"91a5d860-8eb5-4edf-bd3f-00a9cc80c43d","Type":"ContainerStarted","Data":"814812eecab0a657f7119d7dbf3023f86b1a71258004243c4f018bd7d2f58a36"} Sep 17 17:57:31.277376 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:31.277333 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5755p" event={"ID":"67baaaa3-da8b-46d9-9aeb-81d826aee966","Type":"ContainerStarted","Data":"d06f2c9353879773da43db3f454af81699075449a31bf144bb04cc3e52c78596"} Sep 17 17:57:31.299634 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:31.299567 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8v98r" podStartSLOduration=9.194980428 podStartE2EDuration="37.299552545s" totalImagesPullingTime="28.104572117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:31.298125813 +0000 UTC m=+39.444050989" watchObservedRunningTime="2026-09-17 17:57:31.299552545 +0000 UTC m=+39.445477720" Sep 17 17:57:31.323430 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:31.323381 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5755p" podStartSLOduration=1.9899772690000002 podStartE2EDuration="4.323364837s" totalImagesPullingTime="2.333387568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:31.323013848 +0000 UTC m=+39.468939037" watchObservedRunningTime="2026-09-17 17:57:31.323364837 +0000 UTC m=+39.469290053" Sep 17 17:57:32.972058 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.972024 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76698fc49b-lhzw4"] Sep 17 17:57:32.992810 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.992782 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76698fc49b-lhzw4"] Sep 17 17:57:32.992963 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.992885 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:32.996699 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.996672 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 17 17:57:32.996699 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.996693 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 17 17:57:32.997000 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.996979 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 17:57:32.997101 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.997020 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 17:57:32.997101 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.997032 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t822s\"" Sep 17 17:57:32.997182 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.997152 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 17 17:57:32.997237 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:32.997206 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 17 17:57:33.117675 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.117643 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j"] Sep 17 17:57:33.138908 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.138886 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j"] Sep 17 17:57:33.139038 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.138986 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.141056 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.141033 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:57:33.141195 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.141131 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 17:57:33.141290 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.141272 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-srtf9\"" Sep 17 17:57:33.141650 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.141634 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 17:57:33.144370 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.144349 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 17:57:33.148207 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.148191 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.148291 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.148216 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-default-certificate\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.148291 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.148241 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-stats-auth\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.148452 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.148287 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llhcj\" (UniqueName: \"kubernetes.io/projected/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-kube-api-access-llhcj\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.148452 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.148322 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.180673 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.180656 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c"] Sep 17 17:57:33.197206 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.197190 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c" Sep 17 17:57:33.199524 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.199507 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gwt4p\"" Sep 17 17:57:33.199640 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.199543 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 17:57:33.199640 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.199512 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:57:33.204384 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.204362 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c"] Sep 17 17:57:33.249115 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.249057 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhcj\" (UniqueName: \"kubernetes.io/projected/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-kube-api-access-llhcj\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.249115 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.249096 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/759df245-a0e6-4cc0-8440-ac29949a4a99-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-djg9j\" (UID: \"759df245-a0e6-4cc0-8440-ac29949a4a99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.249269 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.249127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/759df245-a0e6-4cc0-8440-ac29949a4a99-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-djg9j\" (UID: \"759df245-a0e6-4cc0-8440-ac29949a4a99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.249269 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.249156 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.249269 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.249242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.249411 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.249281 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:33.749258829 +0000 UTC m=+41.895184000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : configmap references non-existent config key: service-ca.crt Sep 17 17:57:33.249411 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.249309 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-default-certificate\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.249411 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.249317 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:57:33.249411 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.249353 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j687j\" (UniqueName: \"kubernetes.io/projected/759df245-a0e6-4cc0-8440-ac29949a4a99-kube-api-access-j687j\") pod \"kube-storage-version-migrator-operator-55889f7b47-djg9j\" (UID: \"759df245-a0e6-4cc0-8440-ac29949a4a99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.249411 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.249363 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:33.749346411 +0000 UTC m=+41.895271580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : secret "router-metrics-certs-default" not found Sep 17 17:57:33.249411 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.249406 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-stats-auth\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.252749 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.252724 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-stats-auth\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.252749 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.252733 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-default-certificate\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.261050 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.261032 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llhcj\" (UniqueName: \"kubernetes.io/projected/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-kube-api-access-llhcj\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.284996 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.284979 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt"] Sep 17 17:57:33.302842 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.302823 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:33.302842 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.302827 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q"] Sep 17 17:57:33.306161 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.306135 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 17 17:57:33.306243 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.306178 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 17 17:57:33.306318 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.306300 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wt7jz\"" Sep 17 17:57:33.324840 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.324818 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q"] Sep 17 17:57:33.324918 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.324852 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt"] Sep 17 17:57:33.324958 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.324927 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:33.326991 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.326974 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 17:57:33.327123 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.327108 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 17:57:33.327234 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.327221 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:57:33.328047 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.328022 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mcfxk\"" Sep 17 17:57:33.349711 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.349686 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j687j\" (UniqueName: \"kubernetes.io/projected/759df245-a0e6-4cc0-8440-ac29949a4a99-kube-api-access-j687j\") pod \"kube-storage-version-migrator-operator-55889f7b47-djg9j\" (UID: \"759df245-a0e6-4cc0-8440-ac29949a4a99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.349817 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.349743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/759df245-a0e6-4cc0-8440-ac29949a4a99-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-djg9j\" (UID: \"759df245-a0e6-4cc0-8440-ac29949a4a99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.349817 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.349787 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/759df245-a0e6-4cc0-8440-ac29949a4a99-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-djg9j\" (UID: \"759df245-a0e6-4cc0-8440-ac29949a4a99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.349922 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.349873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h2dc\" (UniqueName: \"kubernetes.io/projected/4b4011ea-4ae7-479f-a040-58b7efb07007-kube-api-access-8h2dc\") pod \"volume-data-source-validator-5c4db8bdf9-rhb9c\" (UID: \"4b4011ea-4ae7-479f-a040-58b7efb07007\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c" Sep 17 17:57:33.350369 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.350347 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/759df245-a0e6-4cc0-8440-ac29949a4a99-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-djg9j\" (UID: \"759df245-a0e6-4cc0-8440-ac29949a4a99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.351856 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.351833 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/759df245-a0e6-4cc0-8440-ac29949a4a99-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-djg9j\" (UID: \"759df245-a0e6-4cc0-8440-ac29949a4a99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.364428 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.364407 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j687j\" (UniqueName: \"kubernetes.io/projected/759df245-a0e6-4cc0-8440-ac29949a4a99-kube-api-access-j687j\") pod \"kube-storage-version-migrator-operator-55889f7b47-djg9j\" (UID: \"759df245-a0e6-4cc0-8440-ac29949a4a99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.447799 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.447763 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" Sep 17 17:57:33.451027 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.450998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:33.451159 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.451104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h2dc\" (UniqueName: \"kubernetes.io/projected/4b4011ea-4ae7-479f-a040-58b7efb07007-kube-api-access-8h2dc\") pod \"volume-data-source-validator-5c4db8bdf9-rhb9c\" (UID: \"4b4011ea-4ae7-479f-a040-58b7efb07007\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c" Sep 17 17:57:33.451159 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.451137 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6673fd94-fa13-4b71-b8a5-7244a365f0c9-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:33.451237 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.451177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwgmd\" (UniqueName: \"kubernetes.io/projected/a575fc9d-1d04-4d9f-8389-05af9043d8e5-kube-api-access-qwgmd\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:33.451274 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.451232 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:33.459266 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.459248 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h2dc\" (UniqueName: \"kubernetes.io/projected/4b4011ea-4ae7-479f-a040-58b7efb07007-kube-api-access-8h2dc\") pod \"volume-data-source-validator-5c4db8bdf9-rhb9c\" (UID: \"4b4011ea-4ae7-479f-a040-58b7efb07007\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c" Sep 17 17:57:33.505450 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.505380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c" Sep 17 17:57:33.551869 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.551842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6673fd94-fa13-4b71-b8a5-7244a365f0c9-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:33.551973 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.551896 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgmd\" (UniqueName: \"kubernetes.io/projected/a575fc9d-1d04-4d9f-8389-05af9043d8e5-kube-api-access-qwgmd\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:33.551973 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.551945 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:33.551973 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.551963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:33.552131 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.552070 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:57:33.552131 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.552120 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 17:57:33.552224 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.552142 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls podName:a575fc9d-1d04-4d9f-8389-05af9043d8e5 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:34.052125024 +0000 UTC m=+42.198050178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hxt2q" (UID: "a575fc9d-1d04-4d9f-8389-05af9043d8e5") : secret "samples-operator-tls" not found Sep 17 17:57:33.552224 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.552184 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert podName:6673fd94-fa13-4b71-b8a5-7244a365f0c9 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:34.052169581 +0000 UTC m=+42.198094752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-z8mzt" (UID: "6673fd94-fa13-4b71-b8a5-7244a365f0c9") : secret "networking-console-plugin-cert" not found Sep 17 17:57:33.552631 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.552612 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6673fd94-fa13-4b71-b8a5-7244a365f0c9-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:33.565282 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.565261 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgmd\" (UniqueName: \"kubernetes.io/projected/a575fc9d-1d04-4d9f-8389-05af9043d8e5-kube-api-access-qwgmd\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:33.734292 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.734264 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j"] Sep 17 17:57:33.736872 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:57:33.736847 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759df245_a0e6_4cc0_8440_ac29949a4a99.slice/crio-e566dbc8bcd39b928be12484450bea874f3de1c3ed8815b4a22d8d7c497cd623 WatchSource:0}: Error finding container e566dbc8bcd39b928be12484450bea874f3de1c3ed8815b4a22d8d7c497cd623: Status 404 returned error can't find the container with id e566dbc8bcd39b928be12484450bea874f3de1c3ed8815b4a22d8d7c497cd623 Sep 17 17:57:33.754272 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.754253 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.754372 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.754306 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:33.754410 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.754392 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:57:33.754410 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.754398 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:34.75437922 +0000 UTC m=+42.900304378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : configmap references non-existent config key: service-ca.crt Sep 17 17:57:33.754472 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:33.754427 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:34.754416032 +0000 UTC m=+42.900341190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : secret "router-metrics-certs-default" not found Sep 17 17:57:33.815332 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:33.815274 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c"] Sep 17 17:57:33.818594 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:57:33.818556 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4011ea_4ae7_479f_a040_58b7efb07007.slice/crio-82462f8b9e714c701dcaad3db90ab5aa4612bb8487e7758171e5fa0996be8077 WatchSource:0}: Error finding container 82462f8b9e714c701dcaad3db90ab5aa4612bb8487e7758171e5fa0996be8077: Status 404 returned error can't find the container with id 82462f8b9e714c701dcaad3db90ab5aa4612bb8487e7758171e5fa0996be8077 Sep 17 17:57:34.057745 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:34.057710 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:34.057745 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:34.057750 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:34.058239 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:34.057868 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:57:34.058239 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:34.057876 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 17:57:34.058239 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:34.057928 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert podName:6673fd94-fa13-4b71-b8a5-7244a365f0c9 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:35.057914631 +0000 UTC m=+43.203839786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-z8mzt" (UID: "6673fd94-fa13-4b71-b8a5-7244a365f0c9") : secret "networking-console-plugin-cert" not found Sep 17 17:57:34.058239 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:34.057942 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls podName:a575fc9d-1d04-4d9f-8389-05af9043d8e5 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:35.057935368 +0000 UTC m=+43.203860521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hxt2q" (UID: "a575fc9d-1d04-4d9f-8389-05af9043d8e5") : secret "samples-operator-tls" not found Sep 17 17:57:34.287743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:34.287710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c" event={"ID":"4b4011ea-4ae7-479f-a040-58b7efb07007","Type":"ContainerStarted","Data":"82462f8b9e714c701dcaad3db90ab5aa4612bb8487e7758171e5fa0996be8077"} Sep 17 17:57:34.289146 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:34.289117 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" event={"ID":"759df245-a0e6-4cc0-8440-ac29949a4a99","Type":"ContainerStarted","Data":"e566dbc8bcd39b928be12484450bea874f3de1c3ed8815b4a22d8d7c497cd623"} Sep 17 17:57:34.764788 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:34.764744 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:34.764990 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:34.764847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:34.764990 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:34.764942 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:36.764919119 +0000 UTC m=+44.910844297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : configmap references non-existent config key: service-ca.crt Sep 17 17:57:34.764990 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:34.764952 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:57:34.765151 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:34.765004 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:36.764991867 +0000 UTC m=+44.910917038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : secret "router-metrics-certs-default" not found Sep 17 17:57:35.067652 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:35.067558 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:35.067652 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:35.067612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:35.068106 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:35.067722 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 17:57:35.068106 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:35.067727 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:57:35.068106 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:35.067782 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert podName:6673fd94-fa13-4b71-b8a5-7244a365f0c9 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:37.067764636 +0000 UTC m=+45.213689792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-z8mzt" (UID: "6673fd94-fa13-4b71-b8a5-7244a365f0c9") : secret "networking-console-plugin-cert" not found Sep 17 17:57:35.068106 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:35.067802 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls podName:a575fc9d-1d04-4d9f-8389-05af9043d8e5 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:37.067791567 +0000 UTC m=+45.213716723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hxt2q" (UID: "a575fc9d-1d04-4d9f-8389-05af9043d8e5") : secret "samples-operator-tls" not found Sep 17 17:57:35.269130 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:35.269084 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:35.269294 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:35.269269 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:57:35.269349 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:35.269339 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls podName:7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:43.269322538 +0000 UTC m=+51.415247697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls") pod "dns-default-vtwcr" (UID: "7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d") : secret "dns-default-metrics-tls" not found Sep 17 17:57:35.293078 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:35.293043 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c" event={"ID":"4b4011ea-4ae7-479f-a040-58b7efb07007","Type":"ContainerStarted","Data":"7c650b71a44f5e193e1db30842fd2176530b991fd207faa8ff3cf1a24e6a8075"} Sep 17 17:57:35.309319 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:35.309266 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-rhb9c" podStartSLOduration=1.328867313 podStartE2EDuration="2.309247724s" totalImagesPullingTime="980.380411ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:35.308565695 +0000 UTC m=+43.454490891" watchObservedRunningTime="2026-09-17 17:57:35.309247724 +0000 UTC m=+43.455172901" Sep 17 17:57:36.299100 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:36.299068 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" event={"ID":"759df245-a0e6-4cc0-8440-ac29949a4a99","Type":"ContainerStarted","Data":"9247c5b3d99a319e4f49d667718297482b83c50dcc4be453f57668db2ac3a608"} Sep 17 17:57:36.320190 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:36.320141 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" podStartSLOduration=1.593148562 podStartE2EDuration="3.320122467s" totalImagesPullingTime="1.726973905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:36.31975595 +0000 UTC m=+44.465681141" watchObservedRunningTime="2026-09-17 17:57:36.320122467 +0000 UTC m=+44.466047647" Sep 17 17:57:36.781394 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:36.781354 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:36.781573 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:36.781450 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:36.781573 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:36.781533 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:40.781513573 +0000 UTC m=+48.927438733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : configmap references non-existent config key: service-ca.crt Sep 17 17:57:36.781721 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:36.781596 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:57:36.781721 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:36.781655 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:40.781639368 +0000 UTC m=+48.927564539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : secret "router-metrics-certs-default" not found Sep 17 17:57:37.084196 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.084109 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:37.084196 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.084152 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:37.084459 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:37.084282 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:57:37.084459 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:37.084343 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls podName:a575fc9d-1d04-4d9f-8389-05af9043d8e5 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:41.084329555 +0000 UTC m=+49.230254713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hxt2q" (UID: "a575fc9d-1d04-4d9f-8389-05af9043d8e5") : secret "samples-operator-tls" not found Sep 17 17:57:37.084459 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:37.084283 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 17:57:37.084459 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:37.084413 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert podName:6673fd94-fa13-4b71-b8a5-7244a365f0c9 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:41.084402053 +0000 UTC m=+49.230327225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-z8mzt" (UID: "6673fd94-fa13-4b71-b8a5-7244a365f0c9") : secret "networking-console-plugin-cert" not found Sep 17 17:57:37.177423 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.177394 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq"] Sep 17 17:57:37.179350 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.179335 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq" Sep 17 17:57:37.199215 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.199193 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 17 17:57:37.199745 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.199725 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tggl2\"" Sep 17 17:57:37.204681 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.204665 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 17 17:57:37.285449 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.285420 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4qfc\" (UniqueName: \"kubernetes.io/projected/b8baa213-afcc-4387-92c0-f47badd76ed5-kube-api-access-t4qfc\") pod \"migrator-76794cbd6c-xgclq\" (UID: \"b8baa213-afcc-4387-92c0-f47badd76ed5\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq" Sep 17 17:57:37.366896 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.366811 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq"] Sep 17 17:57:37.386307 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.386275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4qfc\" (UniqueName: \"kubernetes.io/projected/b8baa213-afcc-4387-92c0-f47badd76ed5-kube-api-access-t4qfc\") pod \"migrator-76794cbd6c-xgclq\" (UID: \"b8baa213-afcc-4387-92c0-f47badd76ed5\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq" Sep 17 17:57:37.406322 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.406300 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4qfc\" (UniqueName: \"kubernetes.io/projected/b8baa213-afcc-4387-92c0-f47badd76ed5-kube-api-access-t4qfc\") pod \"migrator-76794cbd6c-xgclq\" (UID: \"b8baa213-afcc-4387-92c0-f47badd76ed5\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq" Sep 17 17:57:37.487510 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.487477 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq" Sep 17 17:57:37.763663 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.763635 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq"] Sep 17 17:57:37.766981 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:57:37.766953 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8baa213_afcc_4387_92c0_f47badd76ed5.slice/crio-0f63f89845b893cde24f98d8c4b5b1c7de1cc064be9518ef60a6429808991f61 WatchSource:0}: Error finding container 0f63f89845b893cde24f98d8c4b5b1c7de1cc064be9518ef60a6429808991f61: Status 404 returned error can't find the container with id 0f63f89845b893cde24f98d8c4b5b1c7de1cc064be9518ef60a6429808991f61 Sep 17 17:57:37.952789 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.952751 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-79bsj"] Sep 17 17:57:37.955369 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.955346 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:37.960661 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.960645 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 17:57:37.960765 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.960649 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 17:57:37.960806 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.960786 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 17:57:37.961466 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.961447 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 17:57:37.961466 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.961449 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vp6pv\"" Sep 17 17:57:37.974680 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:37.974657 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79bsj"] Sep 17 17:57:38.093012 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.092936 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76bd7a97-6224-4ece-9971-a717c07cac25-data-volume\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.093012 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.092985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.093160 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.093093 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76bd7a97-6224-4ece-9971-a717c07cac25-crio-socket\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.093206 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.093161 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.093206 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.093192 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzclw\" (UniqueName: \"kubernetes.io/projected/76bd7a97-6224-4ece-9971-a717c07cac25-kube-api-access-rzclw\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.193962 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.193930 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76bd7a97-6224-4ece-9971-a717c07cac25-data-volume\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.193962 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.193965 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.194154 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.194023 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76bd7a97-6224-4ece-9971-a717c07cac25-crio-socket\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.194154 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.194099 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.194154 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:38.194110 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:57:38.194154 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.194142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzclw\" (UniqueName: \"kubernetes.io/projected/76bd7a97-6224-4ece-9971-a717c07cac25-kube-api-access-rzclw\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.194288 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:38.194240 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:38.694221555 +0000 UTC m=+46.840146719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : configmap "kube-rbac-proxy" not found Sep 17 17:57:38.194288 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:38.194257 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:57:38.194401 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.194298 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76bd7a97-6224-4ece-9971-a717c07cac25-crio-socket\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.194401 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:38.194321 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:38.694300527 +0000 UTC m=+46.840225685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : secret "insights-runtime-extractor-tls" not found Sep 17 17:57:38.194401 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.194260 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76bd7a97-6224-4ece-9971-a717c07cac25-data-volume\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.205962 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.205938 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzclw\" (UniqueName: \"kubernetes.io/projected/76bd7a97-6224-4ece-9971-a717c07cac25-kube-api-access-rzclw\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.305272 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.305236 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq" event={"ID":"b8baa213-afcc-4387-92c0-f47badd76ed5","Type":"ContainerStarted","Data":"0f63f89845b893cde24f98d8c4b5b1c7de1cc064be9518ef60a6429808991f61"} Sep 17 17:57:38.696670 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.696648 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.696947 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:38.696751 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:57:38.696947 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:38.696807 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:39.696789707 +0000 UTC m=+47.842714861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : configmap "kube-rbac-proxy" not found Sep 17 17:57:38.696947 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:38.696754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:38.696947 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:38.696826 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:57:38.696947 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:38.696877 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:39.696861667 +0000 UTC m=+47.842786838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : secret "insights-runtime-extractor-tls" not found Sep 17 17:57:39.309664 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:39.309631 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq" event={"ID":"b8baa213-afcc-4387-92c0-f47badd76ed5","Type":"ContainerStarted","Data":"46b91ebe745e1765d3847067bd50c30e9884b19df6be0e1c295f11f7be2a3b27"} Sep 17 17:57:39.309811 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:39.309680 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq" event={"ID":"b8baa213-afcc-4387-92c0-f47badd76ed5","Type":"ContainerStarted","Data":"f627be3a90cb3977a6d45b03d742ce13913bfa8d5b6a2b2961627352b68c495b"} Sep 17 17:57:39.328691 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:39.328644 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-xgclq" podStartSLOduration=1.4062858 podStartE2EDuration="2.32862913s" totalImagesPullingTime="922.34333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:39.327962015 +0000 UTC m=+47.473887190" watchObservedRunningTime="2026-09-17 17:57:39.32862913 +0000 UTC m=+47.474554318" Sep 17 17:57:39.705226 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:39.705187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:39.705658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:39.705262 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:39.705658 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:39.705334 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:57:39.705658 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:39.705360 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:57:39.705658 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:39.705410 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:41.705395535 +0000 UTC m=+49.851320688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : secret "insights-runtime-extractor-tls" not found Sep 17 17:57:39.705658 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:39.705424 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:41.705418292 +0000 UTC m=+49.851343445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : configmap "kube-rbac-proxy" not found Sep 17 17:57:40.426267 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:40.426239 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-62ddv_b0baf25a-1695-4bef-8be0-42ac37b5d7fe/dns-node-resolver/0.log" Sep 17 17:57:40.812480 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:40.812382 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:40.812876 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:40.812591 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:40.812876 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:40.812616 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:48.812595715 +0000 UTC m=+56.958520877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : configmap references non-existent config key: service-ca.crt Sep 17 17:57:40.812876 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:40.812692 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 17:57:40.812876 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:40.812741 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs podName:3af0452f-d7f2-4ae5-8dfe-21a19c90350f nodeName:}" failed. No retries permitted until 2026-09-17 17:57:48.812730824 +0000 UTC m=+56.958655980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs") pod "router-default-76698fc49b-lhzw4" (UID: "3af0452f-d7f2-4ae5-8dfe-21a19c90350f") : secret "router-metrics-certs-default" not found Sep 17 17:57:41.115238 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:41.115161 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:41.115238 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:41.115200 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:41.115417 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:41.115319 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 17:57:41.115417 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:41.115377 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls podName:a575fc9d-1d04-4d9f-8389-05af9043d8e5 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:49.115363025 +0000 UTC m=+57.261288179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-hxt2q" (UID: "a575fc9d-1d04-4d9f-8389-05af9043d8e5") : secret "samples-operator-tls" not found Sep 17 17:57:41.115417 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:41.115384 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 17:57:41.115515 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:41.115438 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert podName:6673fd94-fa13-4b71-b8a5-7244a365f0c9 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:49.115421514 +0000 UTC m=+57.261346671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-z8mzt" (UID: "6673fd94-fa13-4b71-b8a5-7244a365f0c9") : secret "networking-console-plugin-cert" not found Sep 17 17:57:41.419984 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:41.419954 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9l9j6_8fda8510-3a22-4893-85e3-6f8d335a90bd/node-ca/0.log" Sep 17 17:57:41.722068 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:41.721990 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:41.722232 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:41.722088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:41.722232 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:41.722150 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:57:41.722232 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:41.722171 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:57:41.722232 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:41.722226 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:45.722207014 +0000 UTC m=+53.868132181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : configmap "kube-rbac-proxy" not found Sep 17 17:57:41.722391 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:41.722247 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:45.722237927 +0000 UTC m=+53.868163099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : secret "insights-runtime-extractor-tls" not found Sep 17 17:57:42.233103 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:42.233074 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5755p_67baaaa3-da8b-46d9-9aeb-81d826aee966/serve-healthcheck-canary/0.log" Sep 17 17:57:42.819294 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:42.819265 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-xgclq_b8baa213-afcc-4387-92c0-f47badd76ed5/migrator/0.log" Sep 17 17:57:43.018003 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:43.017977 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-xgclq_b8baa213-afcc-4387-92c0-f47badd76ed5/graceful-termination/0.log" Sep 17 17:57:43.220678 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:43.220630 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-djg9j_759df245-a0e6-4cc0-8440-ac29949a4a99/kube-storage-version-migrator-operator/0.log" Sep 17 17:57:43.336324 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:43.336292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:43.336724 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:43.336429 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:57:43.336724 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:43.336495 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls podName:7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d nodeName:}" failed. No retries permitted until 2026-09-17 17:57:59.336478967 +0000 UTC m=+67.482404121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls") pod "dns-default-vtwcr" (UID: "7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d") : secret "dns-default-metrics-tls" not found Sep 17 17:57:45.755647 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:45.755611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:45.756084 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:45.755667 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:45.756084 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:45.755729 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:57:45.756084 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:45.755774 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:53.755761012 +0000 UTC m=+61.901686182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : configmap "kube-rbac-proxy" not found Sep 17 17:57:45.756084 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:45.755781 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:57:45.756084 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:45.755877 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls podName:76bd7a97-6224-4ece-9971-a717c07cac25 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:53.755860178 +0000 UTC m=+61.901785347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79bsj" (UID: "76bd7a97-6224-4ece-9971-a717c07cac25") : secret "insights-runtime-extractor-tls" not found Sep 17 17:57:48.881187 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:48.881149 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:48.881766 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:48.881236 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:48.881901 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:48.881884 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-service-ca-bundle\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:48.883860 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:48.883836 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3af0452f-d7f2-4ae5-8dfe-21a19c90350f-metrics-certs\") pod \"router-default-76698fc49b-lhzw4\" (UID: \"3af0452f-d7f2-4ae5-8dfe-21a19c90350f\") " pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:48.901928 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:48.901909 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:49.183722 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.183655 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:49.183722 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.183694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:57:49.183889 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:49.183797 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 17 17:57:49.183889 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:57:49.183857 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert podName:6673fd94-fa13-4b71-b8a5-7244a365f0c9 nodeName:}" failed. No retries permitted until 2026-09-17 17:58:05.183842764 +0000 UTC m=+73.329767931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-z8mzt" (UID: "6673fd94-fa13-4b71-b8a5-7244a365f0c9") : secret "networking-console-plugin-cert" not found Sep 17 17:57:49.186165 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.186140 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a575fc9d-1d04-4d9f-8389-05af9043d8e5-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-hxt2q\" (UID: \"a575fc9d-1d04-4d9f-8389-05af9043d8e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:49.201473 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.201450 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76698fc49b-lhzw4"] Sep 17 17:57:49.207118 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:57:49.207096 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3af0452f_d7f2_4ae5_8dfe_21a19c90350f.slice/crio-157f796ca778a3f494a0bb1c10ab50054bb8eaa391f279c4e3edca90ef917f60 WatchSource:0}: Error finding container 157f796ca778a3f494a0bb1c10ab50054bb8eaa391f279c4e3edca90ef917f60: Status 404 returned error can't find the container with id 157f796ca778a3f494a0bb1c10ab50054bb8eaa391f279c4e3edca90ef917f60 Sep 17 17:57:49.236637 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.236618 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" Sep 17 17:57:49.337150 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.337113 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76698fc49b-lhzw4" event={"ID":"3af0452f-d7f2-4ae5-8dfe-21a19c90350f","Type":"ContainerStarted","Data":"8513eaa34ecb32edd604a635c3d863d2acef96bc48e5a056db5e72eac629de24"} Sep 17 17:57:49.337286 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.337178 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76698fc49b-lhzw4" event={"ID":"3af0452f-d7f2-4ae5-8dfe-21a19c90350f","Type":"ContainerStarted","Data":"157f796ca778a3f494a0bb1c10ab50054bb8eaa391f279c4e3edca90ef917f60"} Sep 17 17:57:49.358009 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.357956 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76698fc49b-lhzw4" podStartSLOduration=17.357938288 podStartE2EDuration="17.357938288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:49.357052091 +0000 UTC m=+57.502977266" watchObservedRunningTime="2026-09-17 17:57:49.357938288 +0000 UTC m=+57.503863464" Sep 17 17:57:49.519241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.519167 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q"] Sep 17 17:57:49.902546 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.902515 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:49.904823 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:49.904803 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:50.342063 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:50.341979 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" event={"ID":"a575fc9d-1d04-4d9f-8389-05af9043d8e5","Type":"ContainerStarted","Data":"e74f6294607fa487e2b055363ded1b9a18c455e55c6e3fd9c60dd33924d4eec5"} Sep 17 17:57:50.342216 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:50.342127 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:50.343623 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:50.343602 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76698fc49b-lhzw4" Sep 17 17:57:52.253492 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:52.253463 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8lhr7" Sep 17 17:57:52.350148 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:52.350113 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" event={"ID":"a575fc9d-1d04-4d9f-8389-05af9043d8e5","Type":"ContainerStarted","Data":"e4325cd468156ad78b884097b1b748120bc2ae335736e8790c9ab488eb129b2e"} Sep 17 17:57:52.350305 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:52.350169 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" event={"ID":"a575fc9d-1d04-4d9f-8389-05af9043d8e5","Type":"ContainerStarted","Data":"2980f6867335a532078a4bf443a708186a24e7edc4212862201165122aa070f8"} Sep 17 17:57:52.371781 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:52.371733 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-hxt2q" podStartSLOduration=17.363948848 podStartE2EDuration="19.371718229s" totalImagesPullingTime="2.007769381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:52.371312124 +0000 UTC m=+60.517237299" watchObservedRunningTime="2026-09-17 17:57:52.371718229 +0000 UTC m=+60.517643404" Sep 17 17:57:53.818634 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:53.818560 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:53.818634 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:53.818642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:53.819194 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:53.819176 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76bd7a97-6224-4ece-9971-a717c07cac25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:53.820857 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:53.820824 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76bd7a97-6224-4ece-9971-a717c07cac25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79bsj\" (UID: \"76bd7a97-6224-4ece-9971-a717c07cac25\") " pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:53.863909 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:53.863882 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79bsj" Sep 17 17:57:54.136922 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:54.136899 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79bsj"] Sep 17 17:57:54.140081 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:57:54.140057 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76bd7a97_6224_4ece_9971_a717c07cac25.slice/crio-f8df5198834cebf46f24289ae6607708b2bda537a9db16ca7164a94075e025cc WatchSource:0}: Error finding container f8df5198834cebf46f24289ae6607708b2bda537a9db16ca7164a94075e025cc: Status 404 returned error can't find the container with id f8df5198834cebf46f24289ae6607708b2bda537a9db16ca7164a94075e025cc Sep 17 17:57:54.357933 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:54.357896 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79bsj" event={"ID":"76bd7a97-6224-4ece-9971-a717c07cac25","Type":"ContainerStarted","Data":"04320a69455d83dd18bc90c5ecb4ee752aba02736a9b4b67a3e036503b5365f2"} Sep 17 17:57:54.358094 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:54.357959 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79bsj" event={"ID":"76bd7a97-6224-4ece-9971-a717c07cac25","Type":"ContainerStarted","Data":"f8df5198834cebf46f24289ae6607708b2bda537a9db16ca7164a94075e025cc"} Sep 17 17:57:55.363336 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:55.363299 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79bsj" event={"ID":"76bd7a97-6224-4ece-9971-a717c07cac25","Type":"ContainerStarted","Data":"9137e931cfd48624d9d9e8c9786175a5b1feae0751ef9dec98383fc59a70e337"} Sep 17 17:57:56.367965 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:56.367927 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79bsj" event={"ID":"76bd7a97-6224-4ece-9971-a717c07cac25","Type":"ContainerStarted","Data":"c6fe396d8f8e0058e09fb604dc0201883382818bc25b0ea587b65f4316471f2b"} Sep 17 17:57:56.390921 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:56.390876 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-79bsj" podStartSLOduration=17.801145632 podStartE2EDuration="19.390859265s" totalImagesPullingTime="1.589713633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:57:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:56.390726821 +0000 UTC m=+64.536651996" watchObservedRunningTime="2026-09-17 17:57:56.390859265 +0000 UTC m=+64.536784465" Sep 17 17:57:59.363418 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.363380 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:59.365731 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.365709 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d-metrics-tls\") pod \"dns-default-vtwcr\" (UID: \"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d\") " pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:59.617793 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.617721 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqrn8\"" Sep 17 17:57:59.625107 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.625090 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vtwcr" Sep 17 17:57:59.767324 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.767292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:59.767489 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.767350 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:59.771491 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.771462 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:57:59.771620 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.771536 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:57:59.780023 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.780003 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dd258db-1cff-4db7-a043-b3505b84dfb7-metrics-certs\") pod \"network-metrics-daemon-l2wd2\" (UID: \"6dd258db-1cff-4db7-a043-b3505b84dfb7\") " pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:57:59.780159 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.780142 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/557e8783-4dae-46ee-be7e-90e81efe69d7-original-pull-secret\") pod \"global-pull-secret-syncer-gds4r\" (UID: \"557e8783-4dae-46ee-be7e-90e81efe69d7\") " pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:57:59.868547 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.868464 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:59.873688 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.873672 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:57:59.882646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.882630 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:57:59.893040 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.893016 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nh2q\" (UniqueName: \"kubernetes.io/projected/eb1b686e-ca96-4296-8060-b1ecda60929d-kube-api-access-6nh2q\") pod \"network-check-target-nqzkc\" (UID: \"eb1b686e-ca96-4296-8060-b1ecda60929d\") " pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:57:59.925275 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.925247 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vtwcr"] Sep 17 17:57:59.928208 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:57:59.928188 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0e86bf_c94e_4e3d_8bc1_f1dcfe474e0d.slice/crio-c82bdbf274db904d0c1ebc93e0a8964c465bece1ec941a727963a09be2fbcae7 WatchSource:0}: Error finding container c82bdbf274db904d0c1ebc93e0a8964c465bece1ec941a727963a09be2fbcae7: Status 404 returned error can't find the container with id c82bdbf274db904d0c1ebc93e0a8964c465bece1ec941a727963a09be2fbcae7 Sep 17 17:57:59.993214 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.993190 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7pjs\"" Sep 17 17:57:59.997862 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:57:59.997848 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gds4r" Sep 17 17:58:00.001975 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.001960 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2wd2" Sep 17 17:58:00.006436 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.006418 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jm6gd\"" Sep 17 17:58:00.014936 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.014922 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:58:00.299137 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.299109 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gds4r"] Sep 17 17:58:00.302990 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:00.302966 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557e8783_4dae_46ee_be7e_90e81efe69d7.slice/crio-f9facaf194212da6575dc8937a41da26938a74d2bd139bc546f52f83ed2b77b7 WatchSource:0}: Error finding container f9facaf194212da6575dc8937a41da26938a74d2bd139bc546f52f83ed2b77b7: Status 404 returned error can't find the container with id f9facaf194212da6575dc8937a41da26938a74d2bd139bc546f52f83ed2b77b7 Sep 17 17:58:00.336433 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.336404 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l2wd2"] Sep 17 17:58:00.339916 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:00.339887 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd258db_1cff_4db7_a043_b3505b84dfb7.slice/crio-a517671e907c79a4c451786c18ea82974036765e90c28f5b01762634121a0edd WatchSource:0}: Error finding container a517671e907c79a4c451786c18ea82974036765e90c28f5b01762634121a0edd: Status 404 returned error can't find the container with id a517671e907c79a4c451786c18ea82974036765e90c28f5b01762634121a0edd Sep 17 17:58:00.370875 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.370850 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nqzkc"] Sep 17 17:58:00.373840 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:00.373819 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1b686e_ca96_4296_8060_b1ecda60929d.slice/crio-549d6cfb31c1ed0ac09fdb4558facddc9dffbbd2011ec6a44bedf51de147beba WatchSource:0}: Error finding container 549d6cfb31c1ed0ac09fdb4558facddc9dffbbd2011ec6a44bedf51de147beba: Status 404 returned error can't find the container with id 549d6cfb31c1ed0ac09fdb4558facddc9dffbbd2011ec6a44bedf51de147beba Sep 17 17:58:00.381825 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.381801 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l2wd2" event={"ID":"6dd258db-1cff-4db7-a043-b3505b84dfb7","Type":"ContainerStarted","Data":"a517671e907c79a4c451786c18ea82974036765e90c28f5b01762634121a0edd"} Sep 17 17:58:00.383146 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.383119 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gds4r" event={"ID":"557e8783-4dae-46ee-be7e-90e81efe69d7","Type":"ContainerStarted","Data":"f9facaf194212da6575dc8937a41da26938a74d2bd139bc546f52f83ed2b77b7"} Sep 17 17:58:00.384415 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.384390 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vtwcr" event={"ID":"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d","Type":"ContainerStarted","Data":"c82bdbf274db904d0c1ebc93e0a8964c465bece1ec941a727963a09be2fbcae7"} Sep 17 17:58:00.385393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:00.385376 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nqzkc" event={"ID":"eb1b686e-ca96-4296-8060-b1ecda60929d","Type":"ContainerStarted","Data":"549d6cfb31c1ed0ac09fdb4558facddc9dffbbd2011ec6a44bedf51de147beba"} Sep 17 17:58:02.404541 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:02.404510 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vtwcr" event={"ID":"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d","Type":"ContainerStarted","Data":"0027eecf845c9b7f21efe1c8755761472b0d8e8c20368124075bfd206ade156d"} Sep 17 17:58:02.409321 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:02.409279 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l2wd2" event={"ID":"6dd258db-1cff-4db7-a043-b3505b84dfb7","Type":"ContainerStarted","Data":"130bcdd79d9c135dcd1a61d92b594fba52819e7127b66b70b11f71fbd5dcf5c4"} Sep 17 17:58:03.416110 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:03.416061 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l2wd2" event={"ID":"6dd258db-1cff-4db7-a043-b3505b84dfb7","Type":"ContainerStarted","Data":"a9c1e2392945b17a62fb2e6185cda267077ebae46332fa1e14f18770dc79f25e"} Sep 17 17:58:03.418116 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:03.418087 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vtwcr" event={"ID":"7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d","Type":"ContainerStarted","Data":"519e0852b4b93ad5cac842caf222ee5c8880bd70868e325d9e1f831f81e210ac"} Sep 17 17:58:03.418273 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:03.418196 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vtwcr" Sep 17 17:58:03.442485 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:03.442433 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l2wd2" podStartSLOduration=67.587639902 podStartE2EDuration="1m9.442412877s" totalImagesPullingTime="1.854772975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:03.441907112 +0000 UTC m=+71.587832312" watchObservedRunningTime="2026-09-17 17:58:03.442412877 +0000 UTC m=+71.588338058" Sep 17 17:58:03.471548 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:03.471498 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vtwcr" podStartSLOduration=34.168103868 podStartE2EDuration="36.471483252s" totalImagesPullingTime="2.303379384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:03.470993207 +0000 UTC m=+71.616918405" watchObservedRunningTime="2026-09-17 17:58:03.471483252 +0000 UTC m=+71.617408427" Sep 17 17:58:05.216358 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.216332 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:58:05.218468 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.218449 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6673fd94-fa13-4b71-b8a5-7244a365f0c9-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-z8mzt\" (UID: \"6673fd94-fa13-4b71-b8a5-7244a365f0c9\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:58:05.413553 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.413471 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wt7jz\"" Sep 17 17:58:05.421633 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.421609 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" Sep 17 17:58:05.426249 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.426220 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nqzkc" event={"ID":"eb1b686e-ca96-4296-8060-b1ecda60929d","Type":"ContainerStarted","Data":"caa9620403d91dd37eab69bf600cf3a40b5b04481dfdcf8a223c4d0513a2e1e3"} Sep 17 17:58:05.426359 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.426277 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:58:05.427734 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.427708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gds4r" event={"ID":"557e8783-4dae-46ee-be7e-90e81efe69d7","Type":"ContainerStarted","Data":"1d2faff8b0249df9beffce14ab59b83f6670becf627b4524362dbd03b7fd8911"} Sep 17 17:58:05.472443 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.471972 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nqzkc" podStartSLOduration=66.69205267 podStartE2EDuration="1m11.471955204s" totalImagesPullingTime="4.779902534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:05.449928173 +0000 UTC m=+73.595853372" watchObservedRunningTime="2026-09-17 17:58:05.471955204 +0000 UTC m=+73.617880380" Sep 17 17:58:05.472443 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.472075 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gds4r" podStartSLOduration=66.617854795 podStartE2EDuration="1m11.472069735s" totalImagesPullingTime="4.85421494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:05.469885713 +0000 UTC m=+73.615810889" watchObservedRunningTime="2026-09-17 17:58:05.472069735 +0000 UTC m=+73.617994911" Sep 17 17:58:05.692975 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:05.692911 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt"] Sep 17 17:58:05.696158 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:05.696131 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6673fd94_fa13_4b71_b8a5_7244a365f0c9.slice/crio-bd1f0eaa4474dba3896273354b0219fb14290ba1dc5189c65ac6c2f5ee2122ca WatchSource:0}: Error finding container bd1f0eaa4474dba3896273354b0219fb14290ba1dc5189c65ac6c2f5ee2122ca: Status 404 returned error can't find the container with id bd1f0eaa4474dba3896273354b0219fb14290ba1dc5189c65ac6c2f5ee2122ca Sep 17 17:58:06.432822 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:06.432782 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" event={"ID":"6673fd94-fa13-4b71-b8a5-7244a365f0c9","Type":"ContainerStarted","Data":"bd1f0eaa4474dba3896273354b0219fb14290ba1dc5189c65ac6c2f5ee2122ca"} Sep 17 17:58:07.437095 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:07.437055 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" event={"ID":"6673fd94-fa13-4b71-b8a5-7244a365f0c9","Type":"ContainerStarted","Data":"d24694811d636fed17ab116cfefa8c87e0db4adfa373391700613ad5ebf6cc2b"} Sep 17 17:58:08.060183 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.060128 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-z8mzt" podStartSLOduration=34.033037938 podStartE2EDuration="35.060111002s" totalImagesPullingTime="1.027073064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:07.474403987 +0000 UTC m=+75.620329163" watchObservedRunningTime="2026-09-17 17:58:08.060111002 +0000 UTC m=+76.206036215" Sep 17 17:58:08.060832 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.060812 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw"] Sep 17 17:58:08.065439 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.065420 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" Sep 17 17:58:08.069290 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.069270 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lv5vc\"" Sep 17 17:58:08.069359 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.069305 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 17:58:08.082066 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.082044 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw"] Sep 17 17:58:08.136268 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.136241 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-cr2hw\" (UID: \"96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" Sep 17 17:58:08.237561 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.237518 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-cr2hw\" (UID: \"96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" Sep 17 17:58:08.237708 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:58:08.237684 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 17:58:08.237761 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:58:08.237750 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb-tls-certificates podName:96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb nodeName:}" failed. No retries permitted until 2026-09-17 17:58:08.737732431 +0000 UTC m=+76.883657585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" (UID: "96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 17:58:08.741553 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.741514 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-cr2hw\" (UID: \"96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" Sep 17 17:58:08.744051 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.744027 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-cr2hw\" (UID: \"96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" Sep 17 17:58:08.973306 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:08.973278 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" Sep 17 17:58:09.247347 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:09.247272 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw"] Sep 17 17:58:09.251131 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:09.251103 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e6b629_ffda_4b8e_9fc8_dd9f2afac6bb.slice/crio-b2e62bb4d4eefe97cb2bce34fbe88d9a96c0a820e909059cc69d796ade5a0f90 WatchSource:0}: Error finding container b2e62bb4d4eefe97cb2bce34fbe88d9a96c0a820e909059cc69d796ade5a0f90: Status 404 returned error can't find the container with id b2e62bb4d4eefe97cb2bce34fbe88d9a96c0a820e909059cc69d796ade5a0f90 Sep 17 17:58:09.444271 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:09.444246 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" event={"ID":"96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb","Type":"ContainerStarted","Data":"b2e62bb4d4eefe97cb2bce34fbe88d9a96c0a820e909059cc69d796ade5a0f90"} Sep 17 17:58:10.449180 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:10.449142 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" event={"ID":"96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb","Type":"ContainerStarted","Data":"08bf28e2e2223b62bcf37a23ca24e02bfe9a3112557f3aade10665fe317aa8f6"} Sep 17 17:58:10.449609 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:10.449314 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" Sep 17 17:58:10.453950 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:10.453930 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" Sep 17 17:58:10.477843 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:10.477790 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-cr2hw" podStartSLOduration=1.4834572750000001 podStartE2EDuration="2.477777995s" totalImagesPullingTime="994.32072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:10.477664093 +0000 UTC m=+78.623589280" watchObservedRunningTime="2026-09-17 17:58:10.477777995 +0000 UTC m=+78.623703170" Sep 17 17:58:13.423275 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:13.423246 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vtwcr" Sep 17 17:58:15.780953 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.780917 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82"] Sep 17 17:58:15.785068 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.785049 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4kzgr"] Sep 17 17:58:15.785186 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.785167 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.790176 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.790149 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 17:58:15.790176 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.790153 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 17:58:15.790473 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.790447 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 17:58:15.790631 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.790481 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hjh4n\"" Sep 17 17:58:15.790631 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.790534 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 17:58:15.790820 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.790806 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 17:58:15.792184 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.792167 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.794264 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.794246 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-2n9hm"] Sep 17 17:58:15.794733 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.794714 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 17:58:15.794836 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.794782 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 17:58:15.795003 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.794986 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pk69j\"" Sep 17 17:58:15.796643 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.796626 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 17:58:15.797431 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.797418 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.801869 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.801852 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82"] Sep 17 17:58:15.804632 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.804614 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 17:58:15.804723 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.804649 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 17:58:15.804723 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.804678 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dkzgj\"" Sep 17 17:58:15.805365 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.805346 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 17:58:15.824820 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.824766 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-2n9hm"] Sep 17 17:58:15.890390 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b28c106-1996-41fe-8936-9392942531f0-root\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.890529 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890403 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.890529 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890425 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b28c106-1996-41fe-8936-9392942531f0-metrics-client-ca\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.890529 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890467 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrxzl\" (UniqueName: \"kubernetes.io/projected/f7ade46e-b47c-400d-a301-c89fa02dad4b-kube-api-access-nrxzl\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.890529 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890496 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-tls\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.890529 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.890743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7ade46e-b47c-400d-a301-c89fa02dad4b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.890743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-textfile\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.890743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890570 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plnmw\" (UniqueName: \"kubernetes.io/projected/8b28c106-1996-41fe-8936-9392942531f0-kube-api-access-plnmw\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.890743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.890743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890654 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-wtmp\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.890743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890667 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6408376b-ba97-4a54-9a72-3ddc899d7f10-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.890743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7ade46e-b47c-400d-a301-c89fa02dad4b-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.890743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890713 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.890743 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890731 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6408376b-ba97-4a54-9a72-3ddc899d7f10-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.891028 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890755 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7ade46e-b47c-400d-a301-c89fa02dad4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.891028 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78994\" (UniqueName: \"kubernetes.io/projected/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-api-access-78994\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.891028 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b28c106-1996-41fe-8936-9392942531f0-sys\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.891028 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.890803 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992000 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.991970 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.992000 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992001 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b28c106-1996-41fe-8936-9392942531f0-metrics-client-ca\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992018 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrxzl\" (UniqueName: \"kubernetes.io/projected/f7ade46e-b47c-400d-a301-c89fa02dad4b-kube-api-access-nrxzl\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-tls\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7ade46e-b47c-400d-a301-c89fa02dad4b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992084 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-textfile\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992100 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plnmw\" (UniqueName: \"kubernetes.io/projected/8b28c106-1996-41fe-8936-9392942531f0-kube-api-access-plnmw\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992122 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-wtmp\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992156 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6408376b-ba97-4a54-9a72-3ddc899d7f10-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992181 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7ade46e-b47c-400d-a301-c89fa02dad4b-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.992218 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992217 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6408376b-ba97-4a54-9a72-3ddc899d7f10-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.992778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992278 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7ade46e-b47c-400d-a301-c89fa02dad4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.992778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78994\" (UniqueName: \"kubernetes.io/projected/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-api-access-78994\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.992778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992329 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b28c106-1996-41fe-8936-9392942531f0-sys\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b28c106-1996-41fe-8936-9392942531f0-root\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.992778 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992489 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b28c106-1996-41fe-8936-9392942531f0-root\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.993108 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992893 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-textfile\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.993108 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992917 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.993108 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992938 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7ade46e-b47c-400d-a301-c89fa02dad4b-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.993108 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.992951 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-wtmp\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.993108 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.993000 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b28c106-1996-41fe-8936-9392942531f0-sys\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.993108 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:58:15.993022 2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 17 17:58:15.993108 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.993067 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6408376b-ba97-4a54-9a72-3ddc899d7f10-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.993108 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:58:15.993084 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7ade46e-b47c-400d-a301-c89fa02dad4b-openshift-state-metrics-tls podName:f7ade46e-b47c-400d-a301-c89fa02dad4b nodeName:}" failed. No retries permitted until 2026-09-17 17:58:16.493067211 +0000 UTC m=+84.638992378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f7ade46e-b47c-400d-a301-c89fa02dad4b-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-8lm82" (UID: "f7ade46e-b47c-400d-a301-c89fa02dad4b") : secret "openshift-state-metrics-tls" not found Sep 17 17:58:15.993501 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.993415 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6408376b-ba97-4a54-9a72-3ddc899d7f10-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.993678 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.993658 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.993791 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.993772 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b28c106-1996-41fe-8936-9392942531f0-metrics-client-ca\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.995041 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.995018 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-tls\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.995175 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.995149 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7ade46e-b47c-400d-a301-c89fa02dad4b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:15.995388 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.995369 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:15.995482 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.995435 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b28c106-1996-41fe-8936-9392942531f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:15.995712 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:15.995695 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:16.008209 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.008182 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78994\" (UniqueName: \"kubernetes.io/projected/6408376b-ba97-4a54-9a72-3ddc899d7f10-kube-api-access-78994\") pod \"kube-state-metrics-84c885658c-2n9hm\" (UID: \"6408376b-ba97-4a54-9a72-3ddc899d7f10\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:16.008759 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.008743 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrxzl\" (UniqueName: \"kubernetes.io/projected/f7ade46e-b47c-400d-a301-c89fa02dad4b-kube-api-access-nrxzl\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:16.008823 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.008805 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plnmw\" (UniqueName: \"kubernetes.io/projected/8b28c106-1996-41fe-8936-9392942531f0-kube-api-access-plnmw\") pod \"node-exporter-4kzgr\" (UID: \"8b28c106-1996-41fe-8936-9392942531f0\") " pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:16.105813 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.105758 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4kzgr" Sep 17 17:58:16.110813 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.110797 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" Sep 17 17:58:16.118813 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:16.118784 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b28c106_1996_41fe_8936_9392942531f0.slice/crio-66902307e8738bf3c2d6786ba5de639a4ed2cfb695d992cdacdcec285e35319c WatchSource:0}: Error finding container 66902307e8738bf3c2d6786ba5de639a4ed2cfb695d992cdacdcec285e35319c: Status 404 returned error can't find the container with id 66902307e8738bf3c2d6786ba5de639a4ed2cfb695d992cdacdcec285e35319c Sep 17 17:58:16.396352 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.396320 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-2n9hm"] Sep 17 17:58:16.399051 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:16.399027 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6408376b_ba97_4a54_9a72_3ddc899d7f10.slice/crio-eb923d0cd831d2994990160643b87c469414c5293d4c0413ab373826389603e4 WatchSource:0}: Error finding container eb923d0cd831d2994990160643b87c469414c5293d4c0413ab373826389603e4: Status 404 returned error can't find the container with id eb923d0cd831d2994990160643b87c469414c5293d4c0413ab373826389603e4 Sep 17 17:58:16.472858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.472825 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4kzgr" event={"ID":"8b28c106-1996-41fe-8936-9392942531f0","Type":"ContainerStarted","Data":"66902307e8738bf3c2d6786ba5de639a4ed2cfb695d992cdacdcec285e35319c"} Sep 17 17:58:16.473937 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.473910 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" event={"ID":"6408376b-ba97-4a54-9a72-3ddc899d7f10","Type":"ContainerStarted","Data":"eb923d0cd831d2994990160643b87c469414c5293d4c0413ab373826389603e4"} Sep 17 17:58:16.497389 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.497364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7ade46e-b47c-400d-a301-c89fa02dad4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:16.499731 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.499705 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7ade46e-b47c-400d-a301-c89fa02dad4b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8lm82\" (UID: \"f7ade46e-b47c-400d-a301-c89fa02dad4b\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:16.699318 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.699236 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" Sep 17 17:58:16.853795 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.853760 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:58:16.857995 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.857968 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:16.861855 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.861828 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 17:58:16.862849 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.862819 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 17:58:16.862956 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.862859 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 17:58:16.863089 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.863072 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 17:58:16.863597 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.863464 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 17:58:16.864043 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.863787 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 17:58:16.864043 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.863916 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 17:58:16.864043 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.863981 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 17:58:16.864240 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.864093 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 17:58:16.864240 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.864177 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pfndn\"" Sep 17 17:58:16.878147 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.878124 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:58:16.987472 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:16.987392 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82"] Sep 17 17:58:17.001985 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.001777 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-tls-assets\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.001985 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.001821 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.001985 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.001862 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.001985 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.001896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.001985 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.001931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-config-out\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.002330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.001988 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.002330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.002023 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.002330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.002065 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-web-config\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.002330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.002088 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbcxl\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-kube-api-access-cbcxl\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.002330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.002119 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.002330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.002147 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-config-volume\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.002330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.002173 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.002330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.002209 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.102823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-tls-assets\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.102879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.102908 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.102937 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.102972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-config-out\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.103003 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.103030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.103069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-web-config\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.103090 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbcxl\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-kube-api-access-cbcxl\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.103123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.103150 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-config-volume\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.103175 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.103207 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.103328 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:58:17.103304 2582 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 17 17:58:17.104173 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:58:17.103386 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-main-tls podName:41f6717e-f262-4be0-bcc7-753ae808d334 nodeName:}" failed. No retries permitted until 2026-09-17 17:58:17.603362418 +0000 UTC m=+85.749287592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334") : secret "alertmanager-main-tls" not found Sep 17 17:58:17.105393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.104508 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.105393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.105115 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.107272 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.106938 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.107272 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.106940 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.107439 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.107294 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-web-config\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.107567 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.107538 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.107702 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.107648 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-tls-assets\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.107781 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.107758 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.107838 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.107825 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-config-out\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.107946 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.107927 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-config-volume\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.109352 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.109306 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.117857 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.117818 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbcxl\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-kube-api-access-cbcxl\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.177231 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:17.177203 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ade46e_b47c_400d_a301_c89fa02dad4b.slice/crio-56e61731bedfcc55afda873650eb189021ccc9ddc0d0ba484bd86f3932af30c8 WatchSource:0}: Error finding container 56e61731bedfcc55afda873650eb189021ccc9ddc0d0ba484bd86f3932af30c8: Status 404 returned error can't find the container with id 56e61731bedfcc55afda873650eb189021ccc9ddc0d0ba484bd86f3932af30c8 Sep 17 17:58:17.479797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.479765 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" event={"ID":"f7ade46e-b47c-400d-a301-c89fa02dad4b","Type":"ContainerStarted","Data":"56e61731bedfcc55afda873650eb189021ccc9ddc0d0ba484bd86f3932af30c8"} Sep 17 17:58:17.607349 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.607319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.610152 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.610076 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:17.770209 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:17.770186 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:58:18.075396 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.075322 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:58:18.079432 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:18.079399 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f6717e_f262_4be0_bcc7_753ae808d334.slice/crio-b2d1b2cec62d7a47e1db79b581ebcc872b492373f86d7aa7354903afe77db426 WatchSource:0}: Error finding container b2d1b2cec62d7a47e1db79b581ebcc872b492373f86d7aa7354903afe77db426: Status 404 returned error can't find the container with id b2d1b2cec62d7a47e1db79b581ebcc872b492373f86d7aa7354903afe77db426 Sep 17 17:58:18.485805 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.485770 2582 generic.go:356] "Generic (PLEG): container finished" podID="8b28c106-1996-41fe-8936-9392942531f0" containerID="09ba6af09e1fe50d4da39b846681c4939b46b8c398ccd88cae54d96775d8fcd3" exitCode=0 Sep 17 17:58:18.485968 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.485852 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4kzgr" event={"ID":"8b28c106-1996-41fe-8936-9392942531f0","Type":"ContainerDied","Data":"09ba6af09e1fe50d4da39b846681c4939b46b8c398ccd88cae54d96775d8fcd3"} Sep 17 17:58:18.487123 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.487096 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerStarted","Data":"b2d1b2cec62d7a47e1db79b581ebcc872b492373f86d7aa7354903afe77db426"} Sep 17 17:58:18.489209 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.489189 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" event={"ID":"6408376b-ba97-4a54-9a72-3ddc899d7f10","Type":"ContainerStarted","Data":"321c1ba2eba4034061a2b762f88941479fa4ec8504e156bb16f0b2182710223f"} Sep 17 17:58:18.489297 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.489230 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" event={"ID":"6408376b-ba97-4a54-9a72-3ddc899d7f10","Type":"ContainerStarted","Data":"52668db9346a50e7d1e1572b8bc091aadc1869ee009d59301201c45d7cdfc8d2"} Sep 17 17:58:18.489297 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.489260 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" event={"ID":"6408376b-ba97-4a54-9a72-3ddc899d7f10","Type":"ContainerStarted","Data":"edf242bd317c4c0b05b2105dd82f3866f6be935dba6c77ce6dfad7268033797a"} Sep 17 17:58:18.491098 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.491074 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" event={"ID":"f7ade46e-b47c-400d-a301-c89fa02dad4b","Type":"ContainerStarted","Data":"7cd74e04d0a067188a606cc7f48eb870fb4cabe744cc26d37874f5240d5ec737"} Sep 17 17:58:18.491171 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.491130 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" event={"ID":"f7ade46e-b47c-400d-a301-c89fa02dad4b","Type":"ContainerStarted","Data":"10e9ed44503afde1a7e38642c97ec6f6c227320696144339954863a45ce47e77"} Sep 17 17:58:18.536007 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.535965 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-2n9hm" podStartSLOduration=2.405693551 podStartE2EDuration="3.535950116s" totalImagesPullingTime="1.130256565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:18.534637618 +0000 UTC m=+86.680562815" watchObservedRunningTime="2026-09-17 17:58:18.535950116 +0000 UTC m=+86.681875321" Sep 17 17:58:18.885033 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.885005 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-9bf6db65f-fh8qn"] Sep 17 17:58:18.888705 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.888686 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:18.893883 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.893854 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 17:58:18.894072 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.893881 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 17:58:18.894170 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.894153 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 17:58:18.894305 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.894288 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 17:58:18.894751 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.894722 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-61q1krhpj9sr6\"" Sep 17 17:58:18.894751 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.894739 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 17:58:18.907525 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.907506 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2f9dq\"" Sep 17 17:58:18.916431 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:18.916405 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9bf6db65f-fh8qn"] Sep 17 17:58:19.018096 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.018060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4ffd\" (UniqueName: \"kubernetes.io/projected/8b490a09-01f5-458c-abe9-5f1470b303f8-kube-api-access-k4ffd\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.018264 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.018108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.018264 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.018138 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-tls\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.018264 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.018209 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-grpc-tls\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.018264 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.018254 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.018455 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.018283 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b490a09-01f5-458c-abe9-5f1470b303f8-metrics-client-ca\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.018455 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.018339 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.018455 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.018367 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.119162 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.119132 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-tls\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.119619 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.119192 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-grpc-tls\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.119619 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.119231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.119619 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.119263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b490a09-01f5-458c-abe9-5f1470b303f8-metrics-client-ca\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.119619 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.119300 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.119619 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.119327 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.119619 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.119368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4ffd\" (UniqueName: \"kubernetes.io/projected/8b490a09-01f5-458c-abe9-5f1470b303f8-kube-api-access-k4ffd\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.119619 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.119407 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.120091 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.120065 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b490a09-01f5-458c-abe9-5f1470b303f8-metrics-client-ca\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.121939 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.121909 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.122089 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.122065 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.122180 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.122131 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-grpc-tls\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.122260 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.122236 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-tls\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.122414 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.122395 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.122548 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.122533 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8b490a09-01f5-458c-abe9-5f1470b303f8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.130023 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.129998 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4ffd\" (UniqueName: \"kubernetes.io/projected/8b490a09-01f5-458c-abe9-5f1470b303f8-kube-api-access-k4ffd\") pod \"thanos-querier-9bf6db65f-fh8qn\" (UID: \"8b490a09-01f5-458c-abe9-5f1470b303f8\") " pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.198154 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.198067 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:19.497228 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.497203 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" event={"ID":"f7ade46e-b47c-400d-a301-c89fa02dad4b","Type":"ContainerStarted","Data":"a890721677167ef605e4e9ad1c163bb6bba4ba7045bc73c9ae1ac006d4bd0128"} Sep 17 17:58:19.499278 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.499256 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4kzgr" event={"ID":"8b28c106-1996-41fe-8936-9392942531f0","Type":"ContainerStarted","Data":"c8672532531fe1e09e2138bd022f340146df9046aee77a9d77fe4a97181bc018"} Sep 17 17:58:19.499374 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.499301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4kzgr" event={"ID":"8b28c106-1996-41fe-8936-9392942531f0","Type":"ContainerStarted","Data":"8831ae7fbf691424a1d7bcc6724f59b2adb07548dd537d8bcba3c1a25ea209ad"} Sep 17 17:58:19.500744 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.500722 2582 generic.go:356] "Generic (PLEG): container finished" podID="41f6717e-f262-4be0-bcc7-753ae808d334" containerID="c9195fdefd3f493c5208b28397feb80205a285fcdfc15f5fa563bd978603f099" exitCode=0 Sep 17 17:58:19.500822 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.500797 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerDied","Data":"c9195fdefd3f493c5208b28397feb80205a285fcdfc15f5fa563bd978603f099"} Sep 17 17:58:19.531333 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.531294 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8lm82" podStartSLOduration=3.664931547 podStartE2EDuration="4.531278403s" totalImagesPullingTime="866.346856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:19.529619908 +0000 UTC m=+87.675545100" watchObservedRunningTime="2026-09-17 17:58:19.531278403 +0000 UTC m=+87.677203964" Sep 17 17:58:19.610884 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.610838 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4kzgr" podStartSLOduration=3.121840236 podStartE2EDuration="4.610822879s" totalImagesPullingTime="1.410022158s" totalInitContainerRuntime="78.960485ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:19.609945756 +0000 UTC m=+87.755870955" watchObservedRunningTime="2026-09-17 17:58:19.610822879 +0000 UTC m=+87.756748112" Sep 17 17:58:19.636412 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:19.636389 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9bf6db65f-fh8qn"] Sep 17 17:58:19.638895 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:19.638862 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b490a09_01f5_458c_abe9_5f1470b303f8.slice/crio-5ede53918349a887a12b2b03d93bfa2afab328f0a18a0382a31743911eda228f WatchSource:0}: Error finding container 5ede53918349a887a12b2b03d93bfa2afab328f0a18a0382a31743911eda228f: Status 404 returned error can't find the container with id 5ede53918349a887a12b2b03d93bfa2afab328f0a18a0382a31743911eda228f Sep 17 17:58:20.508221 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.508175 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" event={"ID":"8b490a09-01f5-458c-abe9-5f1470b303f8","Type":"ContainerStarted","Data":"5ede53918349a887a12b2b03d93bfa2afab328f0a18a0382a31743911eda228f"} Sep 17 17:58:20.951935 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.951895 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-566564c77-xng25"] Sep 17 17:58:20.955603 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.955565 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:20.959764 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.959689 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 17 17:58:20.959914 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.959808 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 17 17:58:20.959914 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.959871 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 17 17:58:20.960272 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.960252 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 17 17:58:20.960407 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.960388 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 17 17:58:20.960469 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.960446 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vxm8s\"" Sep 17 17:58:20.966208 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.966177 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 17 17:58:20.983097 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:20.983054 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-566564c77-xng25"] Sep 17 17:58:21.038357 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.038317 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a792eed-8e87-40fb-91a0-daf235a3be2a-metrics-client-ca\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.038605 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.038383 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a792eed-8e87-40fb-91a0-daf235a3be2a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.038605 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.038437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5x2\" (UniqueName: \"kubernetes.io/projected/9a792eed-8e87-40fb-91a0-daf235a3be2a-kube-api-access-fm5x2\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.038605 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.038472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.038605 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.038519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a792eed-8e87-40fb-91a0-daf235a3be2a-serving-certs-ca-bundle\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.038605 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.038551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-telemeter-client-tls\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.038605 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.038596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-secret-telemeter-client\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.038876 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.038676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-federate-client-tls\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.140019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.139971 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a792eed-8e87-40fb-91a0-daf235a3be2a-metrics-client-ca\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.140255 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.140031 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a792eed-8e87-40fb-91a0-daf235a3be2a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.140255 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.140060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5x2\" (UniqueName: \"kubernetes.io/projected/9a792eed-8e87-40fb-91a0-daf235a3be2a-kube-api-access-fm5x2\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.140255 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.140087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.140255 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.140114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a792eed-8e87-40fb-91a0-daf235a3be2a-serving-certs-ca-bundle\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.140255 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.140145 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-telemeter-client-tls\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.140255 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.140181 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-secret-telemeter-client\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.140255 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.140218 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-federate-client-tls\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.141005 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.140966 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a792eed-8e87-40fb-91a0-daf235a3be2a-metrics-client-ca\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.141134 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.141113 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a792eed-8e87-40fb-91a0-daf235a3be2a-serving-certs-ca-bundle\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.141200 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.141169 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a792eed-8e87-40fb-91a0-daf235a3be2a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.143093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.143059 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.143238 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.143185 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-secret-telemeter-client\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.143535 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.143509 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-telemeter-client-tls\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.143696 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.143673 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9a792eed-8e87-40fb-91a0-daf235a3be2a-federate-client-tls\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.152377 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.152344 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5x2\" (UniqueName: \"kubernetes.io/projected/9a792eed-8e87-40fb-91a0-daf235a3be2a-kube-api-access-fm5x2\") pod \"telemeter-client-566564c77-xng25\" (UID: \"9a792eed-8e87-40fb-91a0-daf235a3be2a\") " pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:21.268429 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:21.268325 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-566564c77-xng25" Sep 17 17:58:22.013237 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.013206 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-566564c77-xng25"] Sep 17 17:58:22.015719 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:22.015694 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a792eed_8e87_40fb_91a0_daf235a3be2a.slice/crio-d809061f00c0c78e3e042b64cb21b77242cee54d6158d0f5d9051739e49b8663 WatchSource:0}: Error finding container d809061f00c0c78e3e042b64cb21b77242cee54d6158d0f5d9051739e49b8663: Status 404 returned error can't find the container with id d809061f00c0c78e3e042b64cb21b77242cee54d6158d0f5d9051739e49b8663 Sep 17 17:58:22.388664 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.388624 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:58:22.392899 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.392876 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.395825 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.395802 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 17:58:22.397380 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.397350 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 17:58:22.397598 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.397566 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 17:58:22.397662 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.397641 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 17:58:22.398426 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.398409 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 17:58:22.398615 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.398571 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8ldrl\"" Sep 17 17:58:22.398698 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.398681 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 17:58:22.398829 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.398812 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 17:58:22.399105 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.399086 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ftjrktor4ac7l\"" Sep 17 17:58:22.399242 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.399225 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 17:58:22.399319 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.399258 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 17:58:22.400090 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.400032 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 17:58:22.400193 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.400118 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 17:58:22.400686 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.400660 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 17:58:22.401936 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.401915 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 17:58:22.405032 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.405017 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 17:58:22.405258 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.405243 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 17:58:22.436702 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.436678 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:58:22.449186 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449157 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449314 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449201 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449314 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449234 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-config\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449314 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449496 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449330 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449496 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449496 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449496 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449392 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449496 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449447 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449496 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449470 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449496 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449491 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449610 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449641 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449658 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcgsg\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-kube-api-access-mcgsg\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449714 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449793 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.449858 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449824 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.450223 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.449883 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.522737 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.522701 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" event={"ID":"8b490a09-01f5-458c-abe9-5f1470b303f8","Type":"ContainerStarted","Data":"543d67968c88d422dd46d3d5ef0bd34ad86494759545337d889d17e89b873b3d"} Sep 17 17:58:22.522940 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.522794 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" event={"ID":"8b490a09-01f5-458c-abe9-5f1470b303f8","Type":"ContainerStarted","Data":"ba053d3bd3cbe3e98dc53050c383bdb76bca58d00c5b528bed80f7acc0dff2d0"} Sep 17 17:58:22.522940 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.522836 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" event={"ID":"8b490a09-01f5-458c-abe9-5f1470b303f8","Type":"ContainerStarted","Data":"a1c0cb3c64fd53dfdfb8880938bc0c0e3fe7ca5dc7403235800397bcb106872d"} Sep 17 17:58:22.527237 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.527197 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerStarted","Data":"b88fdac724a4febd4bf36ae340a875862d2855c472512e5a7896b29e885b7f27"} Sep 17 17:58:22.527383 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.527292 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerStarted","Data":"2550dcb3162e89d47279f2c6b3603a2796eb1b2e054c2bea61c970a4ef6dd859"} Sep 17 17:58:22.527383 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.527333 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerStarted","Data":"1e102f1cc9cb8954cb9a8cbbf11eb25d5b83801f6de90cbe38f65e1c78a0dce1"} Sep 17 17:58:22.527383 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.527366 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerStarted","Data":"2d79bccf6f51a287d590667acca3d5c4665ef57e91398193a3733abef7925e4f"} Sep 17 17:58:22.527536 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.527409 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerStarted","Data":"901c4e18930715f2a417522d1a96c73b7b5a74742b0784b0dfc6f0abd7497f70"} Sep 17 17:58:22.528895 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.528866 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566564c77-xng25" event={"ID":"9a792eed-8e87-40fb-91a0-daf235a3be2a","Type":"ContainerStarted","Data":"d809061f00c0c78e3e042b64cb21b77242cee54d6158d0f5d9051739e49b8663"} Sep 17 17:58:22.551446 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551405 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.551655 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551462 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.551655 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551500 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.551655 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551529 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.551655 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551563 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.551655 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.551655 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551666 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551714 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551767 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551789 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcgsg\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-kube-api-access-mcgsg\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551818 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551941 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.551981 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552447 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.552006 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.552497 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.552478 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.553107 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.553077 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.553216 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.553148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-config\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.553216 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.553195 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.556719 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.553484 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.556719 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.554510 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.556719 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.556226 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.558306 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.557034 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.558306 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.557408 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.558540 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.558517 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.559292 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.559235 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.560643 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.560549 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.561200 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.561175 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.563617 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.562074 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-web-config\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.566472 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.566403 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.566908 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.566886 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.567216 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.567186 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.568027 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.568006 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.569262 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.568180 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-config-out\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.569624 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.569599 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.570247 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.570228 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.571352 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.571277 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-config\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.576470 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.576444 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcgsg\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-kube-api-access-mcgsg\") pod \"prometheus-k8s-0\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:22.703569 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:22.703481 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:23.003937 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.003798 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:58:23.009350 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:58:23.009316 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b21146_a561_44e2_81cb_9d3295777d35.slice/crio-b3418d7a58047f94e7a7d8264fb0b6d094fbf8d3327ef9858306e00cb07c3b8f WatchSource:0}: Error finding container b3418d7a58047f94e7a7d8264fb0b6d094fbf8d3327ef9858306e00cb07c3b8f: Status 404 returned error can't find the container with id b3418d7a58047f94e7a7d8264fb0b6d094fbf8d3327ef9858306e00cb07c3b8f Sep 17 17:58:23.538316 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.538235 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" event={"ID":"8b490a09-01f5-458c-abe9-5f1470b303f8","Type":"ContainerStarted","Data":"2288264f449a00a6480d22262f4350930e1248ab87b174b01603643f477c998e"} Sep 17 17:58:23.538805 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.538323 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" event={"ID":"8b490a09-01f5-458c-abe9-5f1470b303f8","Type":"ContainerStarted","Data":"53020d3f335aaaf297a0190e4c4f02fca2322e1b3855fde0c6550233db04b704"} Sep 17 17:58:23.538805 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.538369 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" event={"ID":"8b490a09-01f5-458c-abe9-5f1470b303f8","Type":"ContainerStarted","Data":"c5b3b9081f79f63fef18d6d2a2185061dd2946fa59359941769a8b68d49227af"} Sep 17 17:58:23.538805 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.538415 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:23.540082 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.540056 2582 generic.go:356] "Generic (PLEG): container finished" podID="a7b21146-a561-44e2-81cb-9d3295777d35" containerID="427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3" exitCode=0 Sep 17 17:58:23.540201 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.540147 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerDied","Data":"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3"} Sep 17 17:58:23.540267 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.540230 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerStarted","Data":"b3418d7a58047f94e7a7d8264fb0b6d094fbf8d3327ef9858306e00cb07c3b8f"} Sep 17 17:58:23.544493 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.544475 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerStarted","Data":"1e79081a64c8dee48a8a7e470a272bbc8fd796cc010e966a7a0c9a0df93f152c"} Sep 17 17:58:23.571913 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.571838 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" podStartSLOduration=2.641080999 podStartE2EDuration="5.571818156s" totalImagesPullingTime="2.930737157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:23.571188925 +0000 UTC m=+91.717114121" watchObservedRunningTime="2026-09-17 17:58:23.571818156 +0000 UTC m=+91.717743332" Sep 17 17:58:23.653444 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:23.653387 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.330574632 podStartE2EDuration="7.653370224s" totalImagesPullingTime="4.306895885s" totalInitContainerRuntime="15.899707ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:23.652873249 +0000 UTC m=+91.798798437" watchObservedRunningTime="2026-09-17 17:58:23.653370224 +0000 UTC m=+91.799295400" Sep 17 17:58:24.550517 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:24.550481 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566564c77-xng25" event={"ID":"9a792eed-8e87-40fb-91a0-daf235a3be2a","Type":"ContainerStarted","Data":"d4cd8c89dae455e0f411effb40fce11e06f590c3c00cc4f7220c2ac1555f794a"} Sep 17 17:58:24.550884 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:24.550548 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566564c77-xng25" event={"ID":"9a792eed-8e87-40fb-91a0-daf235a3be2a","Type":"ContainerStarted","Data":"45626d817ca6831fef407ba8e30007fe5a223fe96b04c25f756dec5c2c8b6845"} Sep 17 17:58:25.557734 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:25.557693 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566564c77-xng25" event={"ID":"9a792eed-8e87-40fb-91a0-daf235a3be2a","Type":"ContainerStarted","Data":"50ea99d61708bb4a614aba617dd8ec5f9f7066192642f96fba76df897cf372af"} Sep 17 17:58:25.584979 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:25.584915 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-566564c77-xng25" podStartSLOduration=3.232269441 podStartE2EDuration="5.584890186s" totalImagesPullingTime="2.352620745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:25.582382451 +0000 UTC m=+93.728307660" watchObservedRunningTime="2026-09-17 17:58:25.584890186 +0000 UTC m=+93.730815363" Sep 17 17:58:27.572117 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:27.572078 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerStarted","Data":"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920"} Sep 17 17:58:27.572413 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:27.572176 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerStarted","Data":"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0"} Sep 17 17:58:27.572413 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:27.572219 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerStarted","Data":"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1"} Sep 17 17:58:27.572413 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:27.572254 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerStarted","Data":"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f"} Sep 17 17:58:28.579929 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:28.579894 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerStarted","Data":"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87"} Sep 17 17:58:28.580299 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:28.579959 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerStarted","Data":"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797"} Sep 17 17:58:28.634597 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:28.634511 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.911103149 podStartE2EDuration="6.634489652s" totalImagesPullingTime="3.698062533s" totalInitContainerRuntime="25.32397ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:28.632809509 +0000 UTC m=+96.778734708" watchObservedRunningTime="2026-09-17 17:58:28.634489652 +0000 UTC m=+96.780414830" Sep 17 17:58:29.556725 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:29.556697 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-9bf6db65f-fh8qn" Sep 17 17:58:32.706173 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:32.706113 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:58:36.436079 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:58:36.436046 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nqzkc" Sep 17 17:59:06.744797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:06.744763 2582 generic.go:356] "Generic (PLEG): container finished" podID="759df245-a0e6-4cc0-8440-ac29949a4a99" containerID="9247c5b3d99a319e4f49d667718297482b83c50dcc4be453f57668db2ac3a608" exitCode=0 Sep 17 17:59:06.745224 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:06.744835 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" event={"ID":"759df245-a0e6-4cc0-8440-ac29949a4a99","Type":"ContainerDied","Data":"9247c5b3d99a319e4f49d667718297482b83c50dcc4be453f57668db2ac3a608"} Sep 17 17:59:06.745224 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:06.745164 2582 scope.go:117] "RemoveContainer" containerID="9247c5b3d99a319e4f49d667718297482b83c50dcc4be453f57668db2ac3a608" Sep 17 17:59:07.751241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:07.751208 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-djg9j" event={"ID":"759df245-a0e6-4cc0-8440-ac29949a4a99","Type":"ContainerStarted","Data":"47487db58a01c85a0a12a20d58083993087088ca516cfb30a3d8298d8a78eb23"} Sep 17 17:59:22.705573 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:22.705533 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:22.721563 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:22.721535 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:22.829186 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:22.829158 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:36.712945 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.712860 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:59:36.713427 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.713267 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="alertmanager" containerID="cri-o://901c4e18930715f2a417522d1a96c73b7b5a74742b0784b0dfc6f0abd7497f70" gracePeriod=120 Sep 17 17:59:36.713427 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.713280 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy" containerID="cri-o://2550dcb3162e89d47279f2c6b3603a2796eb1b2e054c2bea61c970a4ef6dd859" gracePeriod=120 Sep 17 17:59:36.713427 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.713313 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="prom-label-proxy" containerID="cri-o://1e79081a64c8dee48a8a7e470a272bbc8fd796cc010e966a7a0c9a0df93f152c" gracePeriod=120 Sep 17 17:59:36.713427 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.713362 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="config-reloader" containerID="cri-o://2d79bccf6f51a287d590667acca3d5c4665ef57e91398193a3733abef7925e4f" gracePeriod=120 Sep 17 17:59:36.713427 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.713323 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy-metric" containerID="cri-o://b88fdac724a4febd4bf36ae340a875862d2855c472512e5a7896b29e885b7f27" gracePeriod=120 Sep 17 17:59:36.713677 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.713280 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy-web" containerID="cri-o://1e102f1cc9cb8954cb9a8cbbf11eb25d5b83801f6de90cbe38f65e1c78a0dce1" gracePeriod=120 Sep 17 17:59:36.873569 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.873535 2582 generic.go:356] "Generic (PLEG): container finished" podID="41f6717e-f262-4be0-bcc7-753ae808d334" containerID="1e79081a64c8dee48a8a7e470a272bbc8fd796cc010e966a7a0c9a0df93f152c" exitCode=0 Sep 17 17:59:36.873569 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.873563 2582 generic.go:356] "Generic (PLEG): container finished" podID="41f6717e-f262-4be0-bcc7-753ae808d334" containerID="2550dcb3162e89d47279f2c6b3603a2796eb1b2e054c2bea61c970a4ef6dd859" exitCode=0 Sep 17 17:59:36.873569 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.873569 2582 generic.go:356] "Generic (PLEG): container finished" podID="41f6717e-f262-4be0-bcc7-753ae808d334" containerID="2d79bccf6f51a287d590667acca3d5c4665ef57e91398193a3733abef7925e4f" exitCode=0 Sep 17 17:59:36.873569 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.873595 2582 generic.go:356] "Generic (PLEG): container finished" podID="41f6717e-f262-4be0-bcc7-753ae808d334" containerID="901c4e18930715f2a417522d1a96c73b7b5a74742b0784b0dfc6f0abd7497f70" exitCode=0 Sep 17 17:59:36.873879 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.873611 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerDied","Data":"1e79081a64c8dee48a8a7e470a272bbc8fd796cc010e966a7a0c9a0df93f152c"} Sep 17 17:59:36.873879 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.873693 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerDied","Data":"2550dcb3162e89d47279f2c6b3603a2796eb1b2e054c2bea61c970a4ef6dd859"} Sep 17 17:59:36.873879 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.873744 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerDied","Data":"2d79bccf6f51a287d590667acca3d5c4665ef57e91398193a3733abef7925e4f"} Sep 17 17:59:36.873879 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:36.873785 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerDied","Data":"901c4e18930715f2a417522d1a96c73b7b5a74742b0784b0dfc6f0abd7497f70"} Sep 17 17:59:37.882676 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:37.882647 2582 generic.go:356] "Generic (PLEG): container finished" podID="41f6717e-f262-4be0-bcc7-753ae808d334" containerID="b88fdac724a4febd4bf36ae340a875862d2855c472512e5a7896b29e885b7f27" exitCode=0 Sep 17 17:59:37.882676 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:37.882673 2582 generic.go:356] "Generic (PLEG): container finished" podID="41f6717e-f262-4be0-bcc7-753ae808d334" containerID="1e102f1cc9cb8954cb9a8cbbf11eb25d5b83801f6de90cbe38f65e1c78a0dce1" exitCode=0 Sep 17 17:59:37.883031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:37.882725 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerDied","Data":"b88fdac724a4febd4bf36ae340a875862d2855c472512e5a7896b29e885b7f27"} Sep 17 17:59:37.883031 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:37.882818 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerDied","Data":"1e102f1cc9cb8954cb9a8cbbf11eb25d5b83801f6de90cbe38f65e1c78a0dce1"} Sep 17 17:59:37.964209 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:37.964186 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:38.043212 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043129 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-config-out\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043212 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043181 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-web-config\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043420 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043223 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-trusted-ca-bundle\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043420 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043266 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-web\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043420 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043344 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-config-volume\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043420 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043369 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbcxl\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-kube-api-access-cbcxl\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043420 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043407 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-main-db\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043716 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043452 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-main-tls\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043716 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043477 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-metrics-client-ca\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043716 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043523 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-cluster-tls-config\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043716 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043556 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043716 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043603 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-tls-assets\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043716 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043644 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-metric\") pod \"41f6717e-f262-4be0-bcc7-753ae808d334\" (UID: \"41f6717e-f262-4be0-bcc7-753ae808d334\") " Sep 17 17:59:38.043716 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043663 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:59:38.044063 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043744 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:59:38.044063 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043963 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.044063 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.043983 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-alertmanager-main-db\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.045344 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.045304 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:59:38.046485 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.046439 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:38.047885 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.047757 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-kube-api-access-cbcxl" (OuterVolumeSpecName: "kube-api-access-cbcxl") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "kube-api-access-cbcxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:59:38.047885 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.047858 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-config-volume" (OuterVolumeSpecName: "config-volume") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:38.048001 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.047957 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-config-out" (OuterVolumeSpecName: "config-out") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:59:38.048043 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.048027 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:59:38.048099 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.048083 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:38.048229 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.048203 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:38.048631 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.048601 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:38.052507 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.052341 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:38.059066 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.059042 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-web-config" (OuterVolumeSpecName: "web-config") pod "41f6717e-f262-4be0-bcc7-753ae808d334" (UID: "41f6717e-f262-4be0-bcc7-753ae808d334"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:38.144510 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144488 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-cluster-tls-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144510 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144510 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144520 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-tls-assets\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144529 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144538 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41f6717e-f262-4be0-bcc7-753ae808d334-config-out\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144547 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-web-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144554 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144563 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144570 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbcxl\" (UniqueName: \"kubernetes.io/projected/41f6717e-f262-4be0-bcc7-753ae808d334-kube-api-access-cbcxl\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144598 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/41f6717e-f262-4be0-bcc7-753ae808d334-secret-alertmanager-main-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.144658 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.144610 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41f6717e-f262-4be0-bcc7-753ae808d334-metrics-client-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:38.890650 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.890616 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41f6717e-f262-4be0-bcc7-753ae808d334","Type":"ContainerDied","Data":"b2d1b2cec62d7a47e1db79b581ebcc872b492373f86d7aa7354903afe77db426"} Sep 17 17:59:38.891047 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.890680 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:38.891047 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.890698 2582 scope.go:117] "RemoveContainer" containerID="1e79081a64c8dee48a8a7e470a272bbc8fd796cc010e966a7a0c9a0df93f152c" Sep 17 17:59:38.898721 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.898702 2582 scope.go:117] "RemoveContainer" containerID="b88fdac724a4febd4bf36ae340a875862d2855c472512e5a7896b29e885b7f27" Sep 17 17:59:38.906060 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.906035 2582 scope.go:117] "RemoveContainer" containerID="2550dcb3162e89d47279f2c6b3603a2796eb1b2e054c2bea61c970a4ef6dd859" Sep 17 17:59:38.912950 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.912935 2582 scope.go:117] "RemoveContainer" containerID="1e102f1cc9cb8954cb9a8cbbf11eb25d5b83801f6de90cbe38f65e1c78a0dce1" Sep 17 17:59:38.919341 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.919321 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:59:38.920533 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.920517 2582 scope.go:117] "RemoveContainer" containerID="2d79bccf6f51a287d590667acca3d5c4665ef57e91398193a3733abef7925e4f" Sep 17 17:59:38.923452 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.923431 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:59:38.928141 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.928123 2582 scope.go:117] "RemoveContainer" containerID="901c4e18930715f2a417522d1a96c73b7b5a74742b0784b0dfc6f0abd7497f70" Sep 17 17:59:38.934966 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.934948 2582 scope.go:117] "RemoveContainer" containerID="c9195fdefd3f493c5208b28397feb80205a285fcdfc15f5fa563bd978603f099" Sep 17 17:59:38.961371 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961349 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:59:38.961720 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961705 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy-metric" Sep 17 17:59:38.961797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961722 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy-metric" Sep 17 17:59:38.961797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961747 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="config-reloader" Sep 17 17:59:38.961797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961756 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="config-reloader" Sep 17 17:59:38.961797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961766 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="alertmanager" Sep 17 17:59:38.961797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961775 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="alertmanager" Sep 17 17:59:38.961797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961786 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy-web" Sep 17 17:59:38.961797 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961794 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy-web" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961804 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="prom-label-proxy" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961813 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="prom-label-proxy" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961825 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961833 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961853 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="init-config-reloader" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961862 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="init-config-reloader" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961962 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="config-reloader" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961972 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961986 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy-metric" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.961997 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="alertmanager" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.962005 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="prom-label-proxy" Sep 17 17:59:38.962136 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.962014 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" containerName="kube-rbac-proxy-web" Sep 17 17:59:38.967628 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.967611 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:38.970700 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.970675 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 17:59:38.971020 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.971005 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pfndn\"" Sep 17 17:59:38.971122 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.971059 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 17:59:38.971425 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.971410 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 17:59:38.971928 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.971909 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 17:59:38.972015 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.971934 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 17:59:38.972015 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.971994 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 17:59:38.972015 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.972004 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 17:59:38.972239 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.972226 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 17:59:38.976647 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.976629 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 17:59:38.981999 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:38.981978 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:59:39.051969 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.051920 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5rxh\" (UniqueName: \"kubernetes.io/projected/89433528-3d6e-45c4-949e-14cc9766b7dd-kube-api-access-k5rxh\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.051969 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.051957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89433528-3d6e-45c4-949e-14cc9766b7dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052091 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.051983 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89433528-3d6e-45c4-949e-14cc9766b7dd-config-out\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052091 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052025 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052091 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052053 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052198 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052130 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052198 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89433528-3d6e-45c4-949e-14cc9766b7dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052198 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052190 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052294 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-web-config\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052294 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052219 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89433528-3d6e-45c4-949e-14cc9766b7dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052294 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052233 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89433528-3d6e-45c4-949e-14cc9766b7dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052294 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052252 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.052294 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.052275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.152713 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.152684 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.152819 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.152718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-web-config\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.152819 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.152741 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89433528-3d6e-45c4-949e-14cc9766b7dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.152819 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.152763 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89433528-3d6e-45c4-949e-14cc9766b7dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.152982 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.152878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.152982 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.152917 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.153093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.153051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5rxh\" (UniqueName: \"kubernetes.io/projected/89433528-3d6e-45c4-949e-14cc9766b7dd-kube-api-access-k5rxh\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.153093 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.153067 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89433528-3d6e-45c4-949e-14cc9766b7dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.153192 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.153130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89433528-3d6e-45c4-949e-14cc9766b7dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.153530 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.153509 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89433528-3d6e-45c4-949e-14cc9766b7dd-config-out\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.153646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.153563 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.153646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.153613 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.153768 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.153669 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.153768 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.153701 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89433528-3d6e-45c4-949e-14cc9766b7dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.153768 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.153700 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89433528-3d6e-45c4-949e-14cc9766b7dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.154074 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.154049 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89433528-3d6e-45c4-949e-14cc9766b7dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.155886 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.155769 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.155886 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.155804 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.155886 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.155861 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.156309 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.156269 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.156498 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.156474 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89433528-3d6e-45c4-949e-14cc9766b7dd-config-out\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.156594 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.156480 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-web-config\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.156710 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.156692 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89433528-3d6e-45c4-949e-14cc9766b7dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.156762 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.156696 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.157724 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.157706 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89433528-3d6e-45c4-949e-14cc9766b7dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.161871 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.161854 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5rxh\" (UniqueName: \"kubernetes.io/projected/89433528-3d6e-45c4-949e-14cc9766b7dd-kube-api-access-k5rxh\") pod \"alertmanager-main-0\" (UID: \"89433528-3d6e-45c4-949e-14cc9766b7dd\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.277573 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.277532 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 17:59:39.586965 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.586940 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 17:59:39.588265 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:59:39.588240 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89433528_3d6e_45c4_949e_14cc9766b7dd.slice/crio-b153d7a80156ec6e5fd7c4f6a2a20a90250f5ee61c543ce15bfa1ace3cca19b6 WatchSource:0}: Error finding container b153d7a80156ec6e5fd7c4f6a2a20a90250f5ee61c543ce15bfa1ace3cca19b6: Status 404 returned error can't find the container with id b153d7a80156ec6e5fd7c4f6a2a20a90250f5ee61c543ce15bfa1ace3cca19b6 Sep 17 17:59:39.896558 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.896529 2582 generic.go:356] "Generic (PLEG): container finished" podID="89433528-3d6e-45c4-949e-14cc9766b7dd" containerID="850630a03d5b87299fb6751a902c6337d81f19bb01478489a7639e4bd9607161" exitCode=0 Sep 17 17:59:39.896983 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.896621 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89433528-3d6e-45c4-949e-14cc9766b7dd","Type":"ContainerDied","Data":"850630a03d5b87299fb6751a902c6337d81f19bb01478489a7639e4bd9607161"} Sep 17 17:59:39.896983 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:39.896709 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89433528-3d6e-45c4-949e-14cc9766b7dd","Type":"ContainerStarted","Data":"b153d7a80156ec6e5fd7c4f6a2a20a90250f5ee61c543ce15bfa1ace3cca19b6"} Sep 17 17:59:40.084983 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:40.084955 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f6717e-f262-4be0-bcc7-753ae808d334" path="/var/lib/kubelet/pods/41f6717e-f262-4be0-bcc7-753ae808d334/volumes" Sep 17 17:59:40.906702 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:40.906670 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89433528-3d6e-45c4-949e-14cc9766b7dd","Type":"ContainerStarted","Data":"3131715a5367b7fa51f78055811679a2452c89def2878106828e8f6f56843e73"} Sep 17 17:59:40.907078 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:40.906762 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89433528-3d6e-45c4-949e-14cc9766b7dd","Type":"ContainerStarted","Data":"6e337b2adeedddebee9290d9d636c606490174f5db967843f531c2ac2b334e7c"} Sep 17 17:59:40.907078 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:40.906793 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89433528-3d6e-45c4-949e-14cc9766b7dd","Type":"ContainerStarted","Data":"7591357f8c6dfda8b659c4735b3dbfd99500716ac732b16fbc27bbea9454f9e3"} Sep 17 17:59:40.907078 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:40.906819 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89433528-3d6e-45c4-949e-14cc9766b7dd","Type":"ContainerStarted","Data":"316951b0be2bde5fd7332cc8e60678bf50882d79d0573ec9aab6198120869708"} Sep 17 17:59:40.907078 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:40.906847 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89433528-3d6e-45c4-949e-14cc9766b7dd","Type":"ContainerStarted","Data":"bfd64a726986a05b5b27d316d3c9216aa9aba41bbf012c26797086b5f00b1a93"} Sep 17 17:59:40.907078 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:40.906880 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89433528-3d6e-45c4-949e-14cc9766b7dd","Type":"ContainerStarted","Data":"c2775363d0680891525c19f275b11418011c360dfa3e521274458023795d2bde"} Sep 17 17:59:41.024225 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.024155 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.010173933 podStartE2EDuration="3.024131303s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.95737ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:59:40.999949943 +0000 UTC m=+169.145875134" watchObservedRunningTime="2026-09-17 17:59:41.024131303 +0000 UTC m=+169.170056481" Sep 17 17:59:41.025669 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.025647 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:59:41.025955 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.025927 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="prometheus" containerID="cri-o://bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" gracePeriod=600 Sep 17 17:59:41.026040 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.025958 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="thanos-sidecar" containerID="cri-o://ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" gracePeriod=600 Sep 17 17:59:41.026040 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.025988 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy-web" containerID="cri-o://0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" gracePeriod=600 Sep 17 17:59:41.026040 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.026002 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="config-reloader" containerID="cri-o://142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" gracePeriod=600 Sep 17 17:59:41.026192 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.025940 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy" containerID="cri-o://e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" gracePeriod=600 Sep 17 17:59:41.026192 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.025981 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy-thanos" containerID="cri-o://02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" gracePeriod=600 Sep 17 17:59:41.268276 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.268254 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:41.374476 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374449 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-trusted-ca-bundle\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.374668 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374494 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-metrics-client-ca\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.374668 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374510 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-2\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.374668 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374527 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcgsg\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-kube-api-access-mcgsg\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.374668 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374550 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-serving-certs-ca-bundle\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.374668 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374601 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-config\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.374668 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374626 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-thanos-prometheus-http-client-file\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.374668 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374657 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-0\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374697 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-kube-rbac-proxy\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374728 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-tls\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374772 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-1\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374821 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374875 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-web-config\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374899 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-metrics-client-certs\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374906 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374926 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-db\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374950 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-kubelet-serving-ca-bundle\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374972 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-tls-assets\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374997 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375012 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375019 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375010 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.374992 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375040 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-grpc-tls\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375079 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-config-out\") pod \"a7b21146-a561-44e2-81cb-9d3295777d35\" (UID: \"a7b21146-a561-44e2-81cb-9d3295777d35\") " Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375253 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375349 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375367 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375382 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-metrics-client-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375398 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375412 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.375660 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375607 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:59:41.376155 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.375919 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:59:41.377293 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.377271 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:41.378464 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.378321 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:41.378464 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.378416 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:41.378664 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.378512 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:41.378664 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.378618 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:59:41.378775 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.378682 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:41.378827 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.378779 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:59:41.379018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.378991 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-config" (OuterVolumeSpecName: "config") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:41.379167 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.379135 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-kube-api-access-mcgsg" (OuterVolumeSpecName: "kube-api-access-mcgsg") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "kube-api-access-mcgsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:59:41.379646 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.379622 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-config-out" (OuterVolumeSpecName: "config-out") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:59:41.379716 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.379688 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:41.380168 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.380150 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:41.390265 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.390245 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-web-config" (OuterVolumeSpecName: "web-config") pod "a7b21146-a561-44e2-81cb-9d3295777d35" (UID: "a7b21146-a561-44e2-81cb-9d3295777d35"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:59:41.475957 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.475871 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.475957 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.475912 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-web-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.475957 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.475926 2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-metrics-client-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.475957 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.475939 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-db\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.475957 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.475951 2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.475957 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.475964 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-tls-assets\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.476241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.475977 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.476241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.475988 2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-grpc-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.476241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.475999 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7b21146-a561-44e2-81cb-9d3295777d35-config-out\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.476241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.476009 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcgsg\" (UniqueName: \"kubernetes.io/projected/a7b21146-a561-44e2-81cb-9d3295777d35-kube-api-access-mcgsg\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.476241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.476020 2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.476241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.476031 2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.476241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.476044 2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a7b21146-a561-44e2-81cb-9d3295777d35-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.476241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.476057 2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-kube-rbac-proxy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.476241 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.476071 2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a7b21146-a561-44e2-81cb-9d3295777d35-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 17:59:41.914547 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914513 2582 generic.go:356] "Generic (PLEG): container finished" podID="a7b21146-a561-44e2-81cb-9d3295777d35" containerID="02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" exitCode=0 Sep 17 17:59:41.914547 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914542 2582 generic.go:356] "Generic (PLEG): container finished" podID="a7b21146-a561-44e2-81cb-9d3295777d35" containerID="e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" exitCode=0 Sep 17 17:59:41.914547 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914550 2582 generic.go:356] "Generic (PLEG): container finished" podID="a7b21146-a561-44e2-81cb-9d3295777d35" containerID="0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" exitCode=0 Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914559 2582 generic.go:356] "Generic (PLEG): container finished" podID="a7b21146-a561-44e2-81cb-9d3295777d35" containerID="ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" exitCode=0 Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914568 2582 generic.go:356] "Generic (PLEG): container finished" podID="a7b21146-a561-44e2-81cb-9d3295777d35" containerID="142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" exitCode=0 Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914599 2582 generic.go:356] "Generic (PLEG): container finished" podID="a7b21146-a561-44e2-81cb-9d3295777d35" containerID="bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" exitCode=0 Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914615 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914609 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerDied","Data":"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87"} Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914776 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerDied","Data":"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797"} Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914823 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerDied","Data":"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920"} Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914837 2582 scope.go:117] "RemoveContainer" containerID="02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914865 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerDied","Data":"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0"} Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerDied","Data":"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1"} Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914945 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerDied","Data":"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f"} Sep 17 17:59:41.914974 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.914983 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a7b21146-a561-44e2-81cb-9d3295777d35","Type":"ContainerDied","Data":"b3418d7a58047f94e7a7d8264fb0b6d094fbf8d3327ef9858306e00cb07c3b8f"} Sep 17 17:59:41.923330 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.923309 2582 scope.go:117] "RemoveContainer" containerID="e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" Sep 17 17:59:41.930185 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.930169 2582 scope.go:117] "RemoveContainer" containerID="0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" Sep 17 17:59:41.937263 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.937245 2582 scope.go:117] "RemoveContainer" containerID="ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" Sep 17 17:59:41.942395 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.942373 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:59:41.944676 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.944665 2582 scope.go:117] "RemoveContainer" containerID="142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" Sep 17 17:59:41.947471 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.947450 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:59:41.951906 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.951892 2582 scope.go:117] "RemoveContainer" containerID="bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" Sep 17 17:59:41.958690 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.958671 2582 scope.go:117] "RemoveContainer" containerID="427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3" Sep 17 17:59:41.965157 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.965144 2582 scope.go:117] "RemoveContainer" containerID="02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" Sep 17 17:59:41.965411 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:59:41.965392 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": container with ID starting with 02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87 not found: ID does not exist" containerID="02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" Sep 17 17:59:41.965466 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.965418 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87"} err="failed to get container status \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": rpc error: code = NotFound desc = could not find container \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": container with ID starting with 02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87 not found: ID does not exist" Sep 17 17:59:41.965466 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.965445 2582 scope.go:117] "RemoveContainer" containerID="e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" Sep 17 17:59:41.970421 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:59:41.966127 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": container with ID starting with e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797 not found: ID does not exist" containerID="e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" Sep 17 17:59:41.970421 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.966174 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797"} err="failed to get container status \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": rpc error: code = NotFound desc = could not find container \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": container with ID starting with e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797 not found: ID does not exist" Sep 17 17:59:41.970421 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.966196 2582 scope.go:117] "RemoveContainer" containerID="0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" Sep 17 17:59:41.970878 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:59:41.970854 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": container with ID starting with 0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920 not found: ID does not exist" containerID="0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" Sep 17 17:59:41.970939 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.970882 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920"} err="failed to get container status \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": rpc error: code = NotFound desc = could not find container \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": container with ID starting with 0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920 not found: ID does not exist" Sep 17 17:59:41.970939 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.970898 2582 scope.go:117] "RemoveContainer" containerID="ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" Sep 17 17:59:41.971165 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:59:41.971146 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": container with ID starting with ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0 not found: ID does not exist" containerID="ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" Sep 17 17:59:41.971262 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.971168 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0"} err="failed to get container status \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": rpc error: code = NotFound desc = could not find container \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": container with ID starting with ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0 not found: ID does not exist" Sep 17 17:59:41.971262 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.971181 2582 scope.go:117] "RemoveContainer" containerID="142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" Sep 17 17:59:41.971382 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:59:41.971366 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": container with ID starting with 142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1 not found: ID does not exist" containerID="142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" Sep 17 17:59:41.971432 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.971385 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1"} err="failed to get container status \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": rpc error: code = NotFound desc = could not find container \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": container with ID starting with 142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1 not found: ID does not exist" Sep 17 17:59:41.971432 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.971396 2582 scope.go:117] "RemoveContainer" containerID="bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" Sep 17 17:59:41.971658 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:59:41.971641 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": container with ID starting with bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f not found: ID does not exist" containerID="bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" Sep 17 17:59:41.971718 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.971662 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f"} err="failed to get container status \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": rpc error: code = NotFound desc = could not find container \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": container with ID starting with bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f not found: ID does not exist" Sep 17 17:59:41.971718 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.971677 2582 scope.go:117] "RemoveContainer" containerID="427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3" Sep 17 17:59:41.971890 ip-10-0-135-240 kubenswrapper[2582]: E0917 17:59:41.971876 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": container with ID starting with 427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3 not found: ID does not exist" containerID="427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3" Sep 17 17:59:41.971939 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.971893 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3"} err="failed to get container status \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": rpc error: code = NotFound desc = could not find container \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": container with ID starting with 427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3 not found: ID does not exist" Sep 17 17:59:41.971939 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.971904 2582 scope.go:117] "RemoveContainer" containerID="02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" Sep 17 17:59:41.972087 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.972072 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87"} err="failed to get container status \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": rpc error: code = NotFound desc = could not find container \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": container with ID starting with 02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87 not found: ID does not exist" Sep 17 17:59:41.972138 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.972087 2582 scope.go:117] "RemoveContainer" containerID="e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" Sep 17 17:59:41.972290 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.972271 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797"} err="failed to get container status \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": rpc error: code = NotFound desc = could not find container \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": container with ID starting with e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797 not found: ID does not exist" Sep 17 17:59:41.972346 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.972290 2582 scope.go:117] "RemoveContainer" containerID="0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" Sep 17 17:59:41.972560 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.972528 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920"} err="failed to get container status \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": rpc error: code = NotFound desc = could not find container \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": container with ID starting with 0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920 not found: ID does not exist" Sep 17 17:59:41.972638 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.972566 2582 scope.go:117] "RemoveContainer" containerID="ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" Sep 17 17:59:41.972921 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.972892 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0"} err="failed to get container status \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": rpc error: code = NotFound desc = could not find container \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": container with ID starting with ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0 not found: ID does not exist" Sep 17 17:59:41.972978 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.972925 2582 scope.go:117] "RemoveContainer" containerID="142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" Sep 17 17:59:41.973193 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.973162 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1"} err="failed to get container status \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": rpc error: code = NotFound desc = could not find container \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": container with ID starting with 142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1 not found: ID does not exist" Sep 17 17:59:41.973245 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.973204 2582 scope.go:117] "RemoveContainer" containerID="bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" Sep 17 17:59:41.973467 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.973449 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f"} err="failed to get container status \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": rpc error: code = NotFound desc = could not find container \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": container with ID starting with bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f not found: ID does not exist" Sep 17 17:59:41.973516 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.973468 2582 scope.go:117] "RemoveContainer" containerID="427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3" Sep 17 17:59:41.973737 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.973710 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3"} err="failed to get container status \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": rpc error: code = NotFound desc = could not find container \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": container with ID starting with 427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3 not found: ID does not exist" Sep 17 17:59:41.973790 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.973737 2582 scope.go:117] "RemoveContainer" containerID="02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" Sep 17 17:59:41.973986 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.973967 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87"} err="failed to get container status \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": rpc error: code = NotFound desc = could not find container \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": container with ID starting with 02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87 not found: ID does not exist" Sep 17 17:59:41.973986 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.973985 2582 scope.go:117] "RemoveContainer" containerID="e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" Sep 17 17:59:41.974268 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.974235 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797"} err="failed to get container status \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": rpc error: code = NotFound desc = could not find container \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": container with ID starting with e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797 not found: ID does not exist" Sep 17 17:59:41.974324 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.974272 2582 scope.go:117] "RemoveContainer" containerID="0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" Sep 17 17:59:41.974605 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.974556 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920"} err="failed to get container status \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": rpc error: code = NotFound desc = could not find container \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": container with ID starting with 0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920 not found: ID does not exist" Sep 17 17:59:41.974657 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.974610 2582 scope.go:117] "RemoveContainer" containerID="ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" Sep 17 17:59:41.974879 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.974861 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0"} err="failed to get container status \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": rpc error: code = NotFound desc = could not find container \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": container with ID starting with ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0 not found: ID does not exist" Sep 17 17:59:41.974921 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.974879 2582 scope.go:117] "RemoveContainer" containerID="142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" Sep 17 17:59:41.975092 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975076 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1"} err="failed to get container status \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": rpc error: code = NotFound desc = could not find container \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": container with ID starting with 142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1 not found: ID does not exist" Sep 17 17:59:41.975135 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975092 2582 scope.go:117] "RemoveContainer" containerID="bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" Sep 17 17:59:41.975283 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975269 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f"} err="failed to get container status \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": rpc error: code = NotFound desc = could not find container \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": container with ID starting with bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f not found: ID does not exist" Sep 17 17:59:41.975326 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975283 2582 scope.go:117] "RemoveContainer" containerID="427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3" Sep 17 17:59:41.975542 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975522 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3"} err="failed to get container status \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": rpc error: code = NotFound desc = could not find container \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": container with ID starting with 427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3 not found: ID does not exist" Sep 17 17:59:41.975607 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975543 2582 scope.go:117] "RemoveContainer" containerID="02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" Sep 17 17:59:41.975767 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975753 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87"} err="failed to get container status \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": rpc error: code = NotFound desc = could not find container \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": container with ID starting with 02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87 not found: ID does not exist" Sep 17 17:59:41.975806 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975767 2582 scope.go:117] "RemoveContainer" containerID="e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" Sep 17 17:59:41.975975 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975959 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797"} err="failed to get container status \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": rpc error: code = NotFound desc = could not find container \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": container with ID starting with e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797 not found: ID does not exist" Sep 17 17:59:41.976016 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.975976 2582 scope.go:117] "RemoveContainer" containerID="0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" Sep 17 17:59:41.976206 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.976189 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920"} err="failed to get container status \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": rpc error: code = NotFound desc = could not find container \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": container with ID starting with 0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920 not found: ID does not exist" Sep 17 17:59:41.976249 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.976216 2582 scope.go:117] "RemoveContainer" containerID="ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" Sep 17 17:59:41.976479 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.976459 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0"} err="failed to get container status \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": rpc error: code = NotFound desc = could not find container \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": container with ID starting with ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0 not found: ID does not exist" Sep 17 17:59:41.976479 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.976479 2582 scope.go:117] "RemoveContainer" containerID="142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" Sep 17 17:59:41.976777 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.976753 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1"} err="failed to get container status \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": rpc error: code = NotFound desc = could not find container \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": container with ID starting with 142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1 not found: ID does not exist" Sep 17 17:59:41.976837 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.976772 2582 scope.go:117] "RemoveContainer" containerID="bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" Sep 17 17:59:41.977094 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.977074 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f"} err="failed to get container status \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": rpc error: code = NotFound desc = could not find container \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": container with ID starting with bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f not found: ID does not exist" Sep 17 17:59:41.977094 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.977092 2582 scope.go:117] "RemoveContainer" containerID="427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3" Sep 17 17:59:41.977297 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.977282 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3"} err="failed to get container status \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": rpc error: code = NotFound desc = could not find container \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": container with ID starting with 427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3 not found: ID does not exist" Sep 17 17:59:41.977337 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.977297 2582 scope.go:117] "RemoveContainer" containerID="02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" Sep 17 17:59:41.977525 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.977507 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87"} err="failed to get container status \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": rpc error: code = NotFound desc = could not find container \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": container with ID starting with 02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87 not found: ID does not exist" Sep 17 17:59:41.977564 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.977527 2582 scope.go:117] "RemoveContainer" containerID="e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" Sep 17 17:59:41.977777 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.977758 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797"} err="failed to get container status \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": rpc error: code = NotFound desc = could not find container \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": container with ID starting with e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797 not found: ID does not exist" Sep 17 17:59:41.977777 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.977777 2582 scope.go:117] "RemoveContainer" containerID="0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" Sep 17 17:59:41.978011 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.977987 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920"} err="failed to get container status \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": rpc error: code = NotFound desc = could not find container \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": container with ID starting with 0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920 not found: ID does not exist" Sep 17 17:59:41.978092 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.978012 2582 scope.go:117] "RemoveContainer" containerID="ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" Sep 17 17:59:41.978281 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.978260 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0"} err="failed to get container status \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": rpc error: code = NotFound desc = could not find container \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": container with ID starting with ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0 not found: ID does not exist" Sep 17 17:59:41.978281 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.978280 2582 scope.go:117] "RemoveContainer" containerID="142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" Sep 17 17:59:41.978506 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.978489 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1"} err="failed to get container status \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": rpc error: code = NotFound desc = could not find container \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": container with ID starting with 142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1 not found: ID does not exist" Sep 17 17:59:41.978560 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.978506 2582 scope.go:117] "RemoveContainer" containerID="bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" Sep 17 17:59:41.978734 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.978717 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f"} err="failed to get container status \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": rpc error: code = NotFound desc = could not find container \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": container with ID starting with bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f not found: ID does not exist" Sep 17 17:59:41.978787 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.978735 2582 scope.go:117] "RemoveContainer" containerID="427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3" Sep 17 17:59:41.978967 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.978951 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3"} err="failed to get container status \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": rpc error: code = NotFound desc = could not find container \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": container with ID starting with 427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3 not found: ID does not exist" Sep 17 17:59:41.979012 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.978967 2582 scope.go:117] "RemoveContainer" containerID="02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87" Sep 17 17:59:41.979165 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.979148 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87"} err="failed to get container status \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": rpc error: code = NotFound desc = could not find container \"02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87\": container with ID starting with 02ed014c98c5974942b5c2b0ebbfe4bd1a37ec09f418a6301245daf98bff9e87 not found: ID does not exist" Sep 17 17:59:41.979203 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.979165 2582 scope.go:117] "RemoveContainer" containerID="e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797" Sep 17 17:59:41.979375 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.979360 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797"} err="failed to get container status \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": rpc error: code = NotFound desc = could not find container \"e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797\": container with ID starting with e0ab890a3540c2e54e814afed7b4533156f51e2a3417a2907476d051c58d4797 not found: ID does not exist" Sep 17 17:59:41.979375 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.979373 2582 scope.go:117] "RemoveContainer" containerID="0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920" Sep 17 17:59:41.979561 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.979542 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920"} err="failed to get container status \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": rpc error: code = NotFound desc = could not find container \"0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920\": container with ID starting with 0b0498239e1a29a321d1120d2e0f6a317b2046bc610338dce2163d5f5a373920 not found: ID does not exist" Sep 17 17:59:41.979656 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.979562 2582 scope.go:117] "RemoveContainer" containerID="ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0" Sep 17 17:59:41.979863 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.979817 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0"} err="failed to get container status \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": rpc error: code = NotFound desc = could not find container \"ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0\": container with ID starting with ddfed3e9cb027941c1a393abefbf6978af78be92c753e51ef016d5b0e31f09c0 not found: ID does not exist" Sep 17 17:59:41.979863 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.979847 2582 scope.go:117] "RemoveContainer" containerID="142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1" Sep 17 17:59:41.980266 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.980098 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1"} err="failed to get container status \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": rpc error: code = NotFound desc = could not find container \"142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1\": container with ID starting with 142c70a106a63e9d0b4fa770397c4c13454dbcface03647fef31072579448bb1 not found: ID does not exist" Sep 17 17:59:41.980266 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.980130 2582 scope.go:117] "RemoveContainer" containerID="bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f" Sep 17 17:59:41.980518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.980497 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f"} err="failed to get container status \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": rpc error: code = NotFound desc = could not find container \"bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f\": container with ID starting with bc3b8b22048405d68d2034368dc0ac0c09ad7ea2e719d4b45b043773a50a882f not found: ID does not exist" Sep 17 17:59:41.980518 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.980519 2582 scope.go:117] "RemoveContainer" containerID="427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3" Sep 17 17:59:41.980768 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.980746 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3"} err="failed to get container status \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": rpc error: code = NotFound desc = could not find container \"427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3\": container with ID starting with 427f1698dc1c772fc6378b6c7a41a6523169cc826397660f912dcb8ac325b7f3 not found: ID does not exist" Sep 17 17:59:41.998860 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.998838 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:59:41.999182 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999169 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy-web" Sep 17 17:59:41.999226 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999184 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy-web" Sep 17 17:59:41.999226 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999196 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy" Sep 17 17:59:41.999226 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999201 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy" Sep 17 17:59:41.999226 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999211 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="init-config-reloader" Sep 17 17:59:41.999226 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999217 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="init-config-reloader" Sep 17 17:59:41.999226 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999227 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="prometheus" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999232 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="prometheus" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999238 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="config-reloader" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999243 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="config-reloader" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999247 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="thanos-sidecar" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999252 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="thanos-sidecar" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999261 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy-thanos" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999266 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy-thanos" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999313 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="config-reloader" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999320 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy-web" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999326 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="prometheus" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999331 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy-thanos" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999337 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="thanos-sidecar" Sep 17 17:59:41.999393 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:41.999343 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" containerName="kube-rbac-proxy" Sep 17 17:59:42.004640 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.004626 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.008066 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.008038 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 17:59:42.008066 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.008055 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 17:59:42.008516 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.008503 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 17:59:42.008832 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.008817 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 17:59:42.009203 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.009189 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 17:59:42.010653 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.010633 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 17:59:42.010792 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.010773 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 17:59:42.010900 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.010824 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ftjrktor4ac7l\"" Sep 17 17:59:42.010900 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.010837 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 17:59:42.010900 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.010894 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 17:59:42.011277 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.010779 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 17:59:42.011277 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.011021 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8ldrl\"" Sep 17 17:59:42.011277 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.011051 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 17:59:42.011277 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.011083 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 17:59:42.014820 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.014803 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 17:59:42.014885 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.014840 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 17:59:42.021301 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.021285 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 17:59:42.030673 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.030630 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:59:42.080237 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080336 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080245 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080336 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080264 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080336 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080282 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-config\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080336 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080296 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080336 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080319 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080520 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080341 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080520 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080520 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080412 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080520 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080465 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080520 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080484 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080520 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080498 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080520 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080514 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfnd\" (UniqueName: \"kubernetes.io/projected/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-kube-api-access-dtfnd\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080770 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080545 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080770 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080560 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080770 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080589 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080770 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080770 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080640 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080770 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080713 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.080770 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.080738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.084030 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.084006 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7b21146-a561-44e2-81cb-9d3295777d35" path="/var/lib/kubelet/pods/a7b21146-a561-44e2-81cb-9d3295777d35/volumes" Sep 17 17:59:42.181682 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.181654 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.181861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.181686 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.181861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.181712 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.181861 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.181834 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-config\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182022 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.181862 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182022 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.181889 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182022 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.181929 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182022 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.181986 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182022 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182012 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182261 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182261 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182261 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182114 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182261 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182136 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfnd\" (UniqueName: \"kubernetes.io/projected/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-kube-api-access-dtfnd\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182261 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182261 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182261 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182230 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182607 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182269 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182607 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182607 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182607 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182818 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182794 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182934 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182886 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.182934 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.182918 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.183397 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.183341 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.183523 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.183500 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.184476 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.184449 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.185752 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.184714 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.185752 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.185020 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.185752 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.185127 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.185752 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.185741 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.186154 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.186110 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.186242 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.186161 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.186242 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.186202 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.187149 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.187104 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.187325 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.187301 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.187504 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.187488 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-config\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.188045 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.188020 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.188215 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.188198 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.188458 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.188444 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.194587 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.194560 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfnd\" (UniqueName: \"kubernetes.io/projected/ceb2215f-bed0-42d2-867b-a5ec1f04f0c7-kube-api-access-dtfnd\") pod \"prometheus-k8s-0\" (UID: \"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.313848 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.313769 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:59:42.602018 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.601946 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:59:42.604681 ip-10-0-135-240 kubenswrapper[2582]: W0917 17:59:42.604658 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb2215f_bed0_42d2_867b_a5ec1f04f0c7.slice/crio-83875e08b3943ade0c3ce4069220abb0ef73af1caf179cff4303af7624db41cd WatchSource:0}: Error finding container 83875e08b3943ade0c3ce4069220abb0ef73af1caf179cff4303af7624db41cd: Status 404 returned error can't find the container with id 83875e08b3943ade0c3ce4069220abb0ef73af1caf179cff4303af7624db41cd Sep 17 17:59:42.921253 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.921222 2582 generic.go:356] "Generic (PLEG): container finished" podID="ceb2215f-bed0-42d2-867b-a5ec1f04f0c7" containerID="96b0fb6d8eb789c086822509299529ecb85ae728d4a70e9bf5d49c9e8d5c8248" exitCode=0 Sep 17 17:59:42.921637 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.921309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7","Type":"ContainerDied","Data":"96b0fb6d8eb789c086822509299529ecb85ae728d4a70e9bf5d49c9e8d5c8248"} Sep 17 17:59:42.921637 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:42.921371 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7","Type":"ContainerStarted","Data":"83875e08b3943ade0c3ce4069220abb0ef73af1caf179cff4303af7624db41cd"} Sep 17 17:59:43.929502 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:43.929468 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7","Type":"ContainerStarted","Data":"19020e388c0287be460d14583d0b137f4174ef6b5c6c691119c7a876117fcac3"} Sep 17 17:59:43.929873 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:43.929568 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7","Type":"ContainerStarted","Data":"95e32b874d6d441b229f776810a12693970b01fbfe0a7e84523cb24ff4f27131"} Sep 17 17:59:43.929873 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:43.929626 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7","Type":"ContainerStarted","Data":"e0da68456497d72845f4437b722302503c5264ca6e4cdb50bcc0c4344581a7d7"} Sep 17 17:59:43.929873 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:43.929655 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7","Type":"ContainerStarted","Data":"5683c6252872a6978e846bd467355fd13ae97871e597d43f763703c73cd278f3"} Sep 17 17:59:43.929873 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:43.929678 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7","Type":"ContainerStarted","Data":"83411253b83054d3950cab03eccf540198726f8312bf9a088641d9c11c15a185"} Sep 17 17:59:43.929873 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:43.929715 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ceb2215f-bed0-42d2-867b-a5ec1f04f0c7","Type":"ContainerStarted","Data":"b211009e57cc29855e41f1962683ab8af6d0893045a7cb578fdc376542430bb6"} Sep 17 17:59:43.959152 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:43.959105 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.940307602 podStartE2EDuration="2.959090839s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.783237ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:59:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:59:43.958946038 +0000 UTC m=+172.104871271" watchObservedRunningTime="2026-09-17 17:59:43.959090839 +0000 UTC m=+172.105016014" Sep 17 17:59:47.314312 ip-10-0-135-240 kubenswrapper[2582]: I0917 17:59:47.314274 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:00:42.314295 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:00:42.314245 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:00:42.330453 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:00:42.330423 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:00:43.182218 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:00:43.182185 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:01:53.961406 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:01:53.961372 2582 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 18:04:44.138744 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.138707 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-6xf5m"] Sep 17 18:04:44.142101 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.142083 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6xf5m" Sep 17 18:04:44.146177 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.146147 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 17 18:04:44.146843 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.146820 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 17 18:04:44.146957 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.146824 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 17 18:04:44.149238 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.149210 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-6krwt\"" Sep 17 18:04:44.153057 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.153041 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 17 18:04:44.172007 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.171976 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-6xf5m"] Sep 17 18:04:44.317506 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.317466 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbzd\" (UniqueName: \"kubernetes.io/projected/84506595-1c65-4ad8-991c-15a13d0b5df6-kube-api-access-mwbzd\") pod \"s3-init-6xf5m\" (UID: \"84506595-1c65-4ad8-991c-15a13d0b5df6\") " pod="kserve/s3-init-6xf5m" Sep 17 18:04:44.317506 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.317518 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84506595-1c65-4ad8-991c-15a13d0b5df6-model-cache\") pod \"s3-init-6xf5m\" (UID: \"84506595-1c65-4ad8-991c-15a13d0b5df6\") " pod="kserve/s3-init-6xf5m" Sep 17 18:04:44.418289 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.418199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbzd\" (UniqueName: \"kubernetes.io/projected/84506595-1c65-4ad8-991c-15a13d0b5df6-kube-api-access-mwbzd\") pod \"s3-init-6xf5m\" (UID: \"84506595-1c65-4ad8-991c-15a13d0b5df6\") " pod="kserve/s3-init-6xf5m" Sep 17 18:04:44.418289 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.418242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84506595-1c65-4ad8-991c-15a13d0b5df6-model-cache\") pod \"s3-init-6xf5m\" (UID: \"84506595-1c65-4ad8-991c-15a13d0b5df6\") " pod="kserve/s3-init-6xf5m" Sep 17 18:04:44.418682 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.418663 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84506595-1c65-4ad8-991c-15a13d0b5df6-model-cache\") pod \"s3-init-6xf5m\" (UID: \"84506595-1c65-4ad8-991c-15a13d0b5df6\") " pod="kserve/s3-init-6xf5m" Sep 17 18:04:44.426598 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.426561 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbzd\" (UniqueName: \"kubernetes.io/projected/84506595-1c65-4ad8-991c-15a13d0b5df6-kube-api-access-mwbzd\") pod \"s3-init-6xf5m\" (UID: \"84506595-1c65-4ad8-991c-15a13d0b5df6\") " pod="kserve/s3-init-6xf5m" Sep 17 18:04:44.469711 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.469670 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6xf5m" Sep 17 18:04:44.741516 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.741439 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-6xf5m"] Sep 17 18:04:44.744776 ip-10-0-135-240 kubenswrapper[2582]: W0917 18:04:44.744745 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84506595_1c65_4ad8_991c_15a13d0b5df6.slice/crio-08bb6a35a491cb05034ab92bc80b99ff7c717848d82d2cced2c91042607f832c WatchSource:0}: Error finding container 08bb6a35a491cb05034ab92bc80b99ff7c717848d82d2cced2c91042607f832c: Status 404 returned error can't find the container with id 08bb6a35a491cb05034ab92bc80b99ff7c717848d82d2cced2c91042607f832c Sep 17 18:04:44.746837 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:44.746821 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 18:04:45.178712 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:45.178681 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6xf5m" event={"ID":"84506595-1c65-4ad8-991c-15a13d0b5df6","Type":"ContainerStarted","Data":"08bb6a35a491cb05034ab92bc80b99ff7c717848d82d2cced2c91042607f832c"} Sep 17 18:04:49.200965 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:49.200924 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6xf5m" event={"ID":"84506595-1c65-4ad8-991c-15a13d0b5df6","Type":"ContainerStarted","Data":"fe9a8a7a039f05140eb807400b5dea0cee3e539208389a688e075c25e0d4f236"} Sep 17 18:04:51.211423 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:51.211390 2582 generic.go:356] "Generic (PLEG): container finished" podID="84506595-1c65-4ad8-991c-15a13d0b5df6" containerID="fe9a8a7a039f05140eb807400b5dea0cee3e539208389a688e075c25e0d4f236" exitCode=0 Sep 17 18:04:51.211822 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:51.211461 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6xf5m" event={"ID":"84506595-1c65-4ad8-991c-15a13d0b5df6","Type":"ContainerDied","Data":"fe9a8a7a039f05140eb807400b5dea0cee3e539208389a688e075c25e0d4f236"} Sep 17 18:04:55.698717 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:55.698691 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 17 18:04:56.237850 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:56.237805 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6xf5m" event={"ID":"84506595-1c65-4ad8-991c-15a13d0b5df6","Type":"ContainerStarted","Data":"01d4333940d04c7ea650baa968079971d70bac2da497adabc4fc2fb4471786bc"} Sep 17 18:04:56.257131 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:04:56.257079 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-6xf5m" podStartSLOduration=2.038266456 podStartE2EDuration="12.257062923s" totalImagesPullingTime="8.481144724s" totalInitContainerRuntime="1.737651743s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:04:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:04:56.255627513 +0000 UTC m=+484.401552690" watchObservedRunningTime="2026-09-17 18:04:56.257062923 +0000 UTC m=+484.402988100" Sep 17 18:06:01.517648 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:01.517609 2582 generic.go:356] "Generic (PLEG): container finished" podID="84506595-1c65-4ad8-991c-15a13d0b5df6" containerID="01d4333940d04c7ea650baa968079971d70bac2da497adabc4fc2fb4471786bc" exitCode=0 Sep 17 18:06:01.518070 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:01.517679 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6xf5m" event={"ID":"84506595-1c65-4ad8-991c-15a13d0b5df6","Type":"ContainerDied","Data":"01d4333940d04c7ea650baa968079971d70bac2da497adabc4fc2fb4471786bc"} Sep 17 18:06:02.646956 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:02.646929 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6xf5m" Sep 17 18:06:02.759149 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:02.759108 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwbzd\" (UniqueName: \"kubernetes.io/projected/84506595-1c65-4ad8-991c-15a13d0b5df6-kube-api-access-mwbzd\") pod \"84506595-1c65-4ad8-991c-15a13d0b5df6\" (UID: \"84506595-1c65-4ad8-991c-15a13d0b5df6\") " Sep 17 18:06:02.759331 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:02.759173 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84506595-1c65-4ad8-991c-15a13d0b5df6-model-cache\") pod \"84506595-1c65-4ad8-991c-15a13d0b5df6\" (UID: \"84506595-1c65-4ad8-991c-15a13d0b5df6\") " Sep 17 18:06:02.761317 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:02.761289 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84506595-1c65-4ad8-991c-15a13d0b5df6-kube-api-access-mwbzd" (OuterVolumeSpecName: "kube-api-access-mwbzd") pod "84506595-1c65-4ad8-991c-15a13d0b5df6" (UID: "84506595-1c65-4ad8-991c-15a13d0b5df6"). InnerVolumeSpecName "kube-api-access-mwbzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:06:02.777647 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:02.777548 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84506595-1c65-4ad8-991c-15a13d0b5df6-model-cache" (OuterVolumeSpecName: "model-cache") pod "84506595-1c65-4ad8-991c-15a13d0b5df6" (UID: "84506595-1c65-4ad8-991c-15a13d0b5df6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:06:02.860305 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:02.860275 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwbzd\" (UniqueName: \"kubernetes.io/projected/84506595-1c65-4ad8-991c-15a13d0b5df6-kube-api-access-mwbzd\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:06:02.860305 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:02.860302 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84506595-1c65-4ad8-991c-15a13d0b5df6-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:06:03.528098 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:03.528068 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-6xf5m" Sep 17 18:06:03.528296 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:03.528071 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-6xf5m" event={"ID":"84506595-1c65-4ad8-991c-15a13d0b5df6","Type":"ContainerDied","Data":"08bb6a35a491cb05034ab92bc80b99ff7c717848d82d2cced2c91042607f832c"} Sep 17 18:06:03.528296 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:03.528172 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08bb6a35a491cb05034ab92bc80b99ff7c717848d82d2cced2c91042607f832c" Sep 17 18:06:16.150653 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.150619 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7"] Sep 17 18:06:16.151070 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.150966 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84506595-1c65-4ad8-991c-15a13d0b5df6" containerName="download-hf-model" Sep 17 18:06:16.151070 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.150977 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="84506595-1c65-4ad8-991c-15a13d0b5df6" containerName="download-hf-model" Sep 17 18:06:16.151070 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.150986 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84506595-1c65-4ad8-991c-15a13d0b5df6" containerName="s3-init" Sep 17 18:06:16.151070 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.150991 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="84506595-1c65-4ad8-991c-15a13d0b5df6" containerName="s3-init" Sep 17 18:06:16.151070 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.151062 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="84506595-1c65-4ad8-991c-15a13d0b5df6" containerName="s3-init" Sep 17 18:06:16.153055 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.153039 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.157377 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.157357 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 17 18:06:16.157482 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.157385 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Sep 17 18:06:16.157970 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.157950 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 17 18:06:16.158053 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.157968 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 17 18:06:16.158053 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.158033 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hn8w8\"" Sep 17 18:06:16.158053 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.158044 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 17 18:06:16.158195 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.157968 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Sep 17 18:06:16.167862 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.167840 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7"] Sep 17 18:06:16.277763 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.277725 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dprt7\" (UniqueName: \"kubernetes.io/projected/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-api-access-dprt7\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.277920 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.277779 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a18f7964-2bef-40e9-8a03-6e255ce79dc5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.277920 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.277804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.277920 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.277830 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.278025 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.277973 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.342054 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.342021 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7"] Sep 17 18:06:16.344614 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.344597 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.346893 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.346873 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Sep 17 18:06:16.346989 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.346968 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Sep 17 18:06:16.356908 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.356885 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7"] Sep 17 18:06:16.378506 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.378479 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.378658 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.378614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dprt7\" (UniqueName: \"kubernetes.io/projected/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-api-access-dprt7\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.378730 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.378664 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a18f7964-2bef-40e9-8a03-6e255ce79dc5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.378730 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.378694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.378730 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.378721 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.379148 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.379126 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.379783 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.379763 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.379874 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.379796 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.381949 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.381927 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a18f7964-2bef-40e9-8a03-6e255ce79dc5-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.388345 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.388322 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dprt7\" (UniqueName: \"kubernetes.io/projected/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-api-access-dprt7\") pod \"isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.462909 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.462854 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:16.479970 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.479940 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvgs2\" (UniqueName: \"kubernetes.io/projected/aaecf815-c12f-412a-8e12-1f575a62d407-kube-api-access-xvgs2\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.480054 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.479984 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaecf815-c12f-412a-8e12-1f575a62d407-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.480110 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.480053 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.480110 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.480099 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.480193 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.480128 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaecf815-c12f-412a-8e12-1f575a62d407-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.580936 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.580905 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.581102 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.580967 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaecf815-c12f-412a-8e12-1f575a62d407-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.581102 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.581005 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvgs2\" (UniqueName: \"kubernetes.io/projected/aaecf815-c12f-412a-8e12-1f575a62d407-kube-api-access-xvgs2\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.581102 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.581036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaecf815-c12f-412a-8e12-1f575a62d407-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.581102 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.581066 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.581102 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:06:16.581098 2582 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found Sep 17 18:06:16.581374 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:06:16.581164 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaecf815-c12f-412a-8e12-1f575a62d407-proxy-tls podName:aaecf815-c12f-412a-8e12-1f575a62d407 nodeName:}" failed. No retries permitted until 2026-09-17 18:06:17.081144284 +0000 UTC m=+565.227069462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/aaecf815-c12f-412a-8e12-1f575a62d407-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-t74n7" (UID: "aaecf815-c12f-412a-8e12-1f575a62d407") : secret "isvc-xgboost-graph-predictor-serving-cert" not found Sep 17 18:06:16.581491 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.581444 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaecf815-c12f-412a-8e12-1f575a62d407-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.581692 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.581671 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.581768 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.581693 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.589656 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.589632 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvgs2\" (UniqueName: \"kubernetes.io/projected/aaecf815-c12f-412a-8e12-1f575a62d407-kube-api-access-xvgs2\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:16.638840 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.638811 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp"] Sep 17 18:06:16.642036 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.642018 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.644088 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.644072 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Sep 17 18:06:16.644771 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.644758 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Sep 17 18:06:16.654038 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.654015 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp"] Sep 17 18:06:16.742597 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.742556 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7"] Sep 17 18:06:16.744690 ip-10-0-135-240 kubenswrapper[2582]: W0917 18:06:16.744662 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18f7964_2bef_40e9_8a03_6e255ce79dc5.slice/crio-7d177bc2fb14c34ec5406b8f3010860777c52a3f5ca3f41b283b8afd0ce79ab6 WatchSource:0}: Error finding container 7d177bc2fb14c34ec5406b8f3010860777c52a3f5ca3f41b283b8afd0ce79ab6: Status 404 returned error can't find the container with id 7d177bc2fb14c34ec5406b8f3010860777c52a3f5ca3f41b283b8afd0ce79ab6 Sep 17 18:06:16.783510 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.783486 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a22771e-e020-452f-bd08-f618e31386f8-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.783635 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.783546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.783635 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.783593 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2a22771e-e020-452f-bd08-f618e31386f8-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.783747 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.783689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.783747 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.783717 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlcnq\" (UniqueName: \"kubernetes.io/projected/2a22771e-e020-452f-bd08-f618e31386f8-kube-api-access-dlcnq\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.884932 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.884896 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.884932 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.884936 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2a22771e-e020-452f-bd08-f618e31386f8-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.885175 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.885006 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.885175 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.885033 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcnq\" (UniqueName: \"kubernetes.io/projected/2a22771e-e020-452f-bd08-f618e31386f8-kube-api-access-dlcnq\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.885175 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.885086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a22771e-e020-452f-bd08-f618e31386f8-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.885460 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.885439 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a22771e-e020-452f-bd08-f618e31386f8-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.885711 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.885691 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.885804 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.885781 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.887327 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.887309 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2a22771e-e020-452f-bd08-f618e31386f8-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.894552 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.894528 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlcnq\" (UniqueName: \"kubernetes.io/projected/2a22771e-e020-452f-bd08-f618e31386f8-kube-api-access-dlcnq\") pod \"isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:16.952359 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:16.952333 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:17.086304 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.086266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaecf815-c12f-412a-8e12-1f575a62d407-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:17.088501 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.088479 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaecf815-c12f-412a-8e12-1f575a62d407-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t74n7\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:17.238453 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.238426 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp"] Sep 17 18:06:17.240919 ip-10-0-135-240 kubenswrapper[2582]: W0917 18:06:17.240896 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a22771e_e020_452f_bd08_f618e31386f8.slice/crio-ce762129d1d3858c1fc562db30e313128d4b9710cc1f2b1cadb269fb80896b34 WatchSource:0}: Error finding container ce762129d1d3858c1fc562db30e313128d4b9710cc1f2b1cadb269fb80896b34: Status 404 returned error can't find the container with id ce762129d1d3858c1fc562db30e313128d4b9710cc1f2b1cadb269fb80896b34 Sep 17 18:06:17.255087 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.255059 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:17.547602 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.547430 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7"] Sep 17 18:06:17.550132 ip-10-0-135-240 kubenswrapper[2582]: W0917 18:06:17.550095 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaecf815_c12f_412a_8e12_1f575a62d407.slice/crio-de174956122d38cb61529f05cf97b311bae0791cf4bd81d58de133f4194e2ce1 WatchSource:0}: Error finding container de174956122d38cb61529f05cf97b311bae0791cf4bd81d58de133f4194e2ce1: Status 404 returned error can't find the container with id de174956122d38cb61529f05cf97b311bae0791cf4bd81d58de133f4194e2ce1 Sep 17 18:06:17.593448 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.593414 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" event={"ID":"aaecf815-c12f-412a-8e12-1f575a62d407","Type":"ContainerStarted","Data":"de174956122d38cb61529f05cf97b311bae0791cf4bd81d58de133f4194e2ce1"} Sep 17 18:06:17.595135 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.595105 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" event={"ID":"2a22771e-e020-452f-bd08-f618e31386f8","Type":"ContainerStarted","Data":"dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289"} Sep 17 18:06:17.595260 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.595174 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" event={"ID":"2a22771e-e020-452f-bd08-f618e31386f8","Type":"ContainerStarted","Data":"ce762129d1d3858c1fc562db30e313128d4b9710cc1f2b1cadb269fb80896b34"} Sep 17 18:06:17.596814 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.596786 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" event={"ID":"a18f7964-2bef-40e9-8a03-6e255ce79dc5","Type":"ContainerStarted","Data":"377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b"} Sep 17 18:06:17.596929 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:17.596845 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" event={"ID":"a18f7964-2bef-40e9-8a03-6e255ce79dc5","Type":"ContainerStarted","Data":"7d177bc2fb14c34ec5406b8f3010860777c52a3f5ca3f41b283b8afd0ce79ab6"} Sep 17 18:06:18.603405 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:18.603364 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" event={"ID":"aaecf815-c12f-412a-8e12-1f575a62d407","Type":"ContainerStarted","Data":"693de788c424b4c8d6f12864e609cd2f4f696cce7b2eabaf19f36bb603ea8ed8"} Sep 17 18:06:21.619530 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:21.619444 2582 generic.go:356] "Generic (PLEG): container finished" podID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerID="377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b" exitCode=0 Sep 17 18:06:21.620046 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:21.619519 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" event={"ID":"a18f7964-2bef-40e9-8a03-6e255ce79dc5","Type":"ContainerDied","Data":"377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b"} Sep 17 18:06:21.621310 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:21.621262 2582 generic.go:356] "Generic (PLEG): container finished" podID="aaecf815-c12f-412a-8e12-1f575a62d407" containerID="693de788c424b4c8d6f12864e609cd2f4f696cce7b2eabaf19f36bb603ea8ed8" exitCode=0 Sep 17 18:06:21.621377 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:21.621328 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" event={"ID":"aaecf815-c12f-412a-8e12-1f575a62d407","Type":"ContainerDied","Data":"693de788c424b4c8d6f12864e609cd2f4f696cce7b2eabaf19f36bb603ea8ed8"} Sep 17 18:06:21.623097 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:21.623074 2582 generic.go:356] "Generic (PLEG): container finished" podID="2a22771e-e020-452f-bd08-f618e31386f8" containerID="dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289" exitCode=0 Sep 17 18:06:21.623200 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:21.623116 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" event={"ID":"2a22771e-e020-452f-bd08-f618e31386f8","Type":"ContainerDied","Data":"dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289"} Sep 17 18:06:51.855291 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:51.855183 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" event={"ID":"a18f7964-2bef-40e9-8a03-6e255ce79dc5","Type":"ContainerStarted","Data":"95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111"} Sep 17 18:06:51.859418 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:51.859321 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" event={"ID":"aaecf815-c12f-412a-8e12-1f575a62d407","Type":"ContainerStarted","Data":"316e2326a07cb465c4ec09384619fbe505f764fd873df4d80299c18009781fd2"} Sep 17 18:06:51.862469 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:51.862387 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" event={"ID":"2a22771e-e020-452f-bd08-f618e31386f8","Type":"ContainerStarted","Data":"a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5"} Sep 17 18:06:54.881662 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.881618 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" event={"ID":"2a22771e-e020-452f-bd08-f618e31386f8","Type":"ContainerStarted","Data":"954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603"} Sep 17 18:06:54.882269 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.882169 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:54.882269 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.882228 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:06:54.883989 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.883937 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:06:54.885041 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.885009 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" event={"ID":"a18f7964-2bef-40e9-8a03-6e255ce79dc5","Type":"ContainerStarted","Data":"7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c"} Sep 17 18:06:54.885220 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.885077 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:54.885220 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.885110 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:06:54.886430 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.886374 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:06:54.887789 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.887765 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" event={"ID":"aaecf815-c12f-412a-8e12-1f575a62d407","Type":"ContainerStarted","Data":"8bec27b3f9462506c258639bb4fb61dc562de8b76a6eb50dcb1ae347d0189a79"} Sep 17 18:06:54.887958 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.887937 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:54.906078 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.906027 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podStartSLOduration=3.041398597 podStartE2EDuration="38.906009747s" totalImagesPullingTime="32.115450818s" totalInitContainerRuntime="3.749160332s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:06:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:06:54.903823909 +0000 UTC m=+603.049749076" watchObservedRunningTime="2026-09-17 18:06:54.906009747 +0000 UTC m=+603.051934923" Sep 17 18:06:54.926861 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.926804 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podStartSLOduration=2.971521202 podStartE2EDuration="38.926781778s" totalImagesPullingTime="32.258901409s" totalInitContainerRuntime="3.696359167s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:06:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:06:54.926089027 +0000 UTC m=+603.072014240" watchObservedRunningTime="2026-09-17 18:06:54.926781778 +0000 UTC m=+603.072706955" Sep 17 18:06:54.945856 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:54.945813 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podStartSLOduration=2.800532962 podStartE2EDuration="38.945797664s" totalImagesPullingTime="32.243954146s" totalInitContainerRuntime="3.901310556s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:06:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:06:54.944237457 +0000 UTC m=+603.090162632" watchObservedRunningTime="2026-09-17 18:06:54.945797664 +0000 UTC m=+603.091722840" Sep 17 18:06:55.894020 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:55.893971 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:06:55.894474 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:55.894074 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:06:55.894474 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:55.894421 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:06:55.895300 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:55.895276 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Sep 17 18:06:56.899930 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:06:56.899889 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Sep 17 18:07:00.898936 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:00.898908 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:07:00.899302 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:00.898999 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:07:00.899465 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:00.899442 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:07:00.899748 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:00.899720 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:07:01.903743 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:01.903716 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:07:01.904249 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:01.904221 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Sep 17 18:07:10.899987 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:10.899901 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:07:10.900427 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:10.899901 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:07:11.904421 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:11.904384 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Sep 17 18:07:20.900130 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:20.900090 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:07:20.900598 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:20.900090 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:07:21.904447 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:21.904408 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Sep 17 18:07:30.899515 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:30.899480 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:07:30.899904 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:30.899734 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:07:31.904827 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:31.904781 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Sep 17 18:07:40.899620 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:40.899555 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:07:40.900125 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:40.899736 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:07:41.904178 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:41.904137 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Sep 17 18:07:50.900422 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:50.900380 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:07:50.901034 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:50.900378 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:07:51.904185 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:07:51.904143 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused" Sep 17 18:08:00.899648 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:00.899606 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:08:00.900125 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:00.899682 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:08:01.905176 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:01.905132 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:08:10.899753 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:10.899721 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:08:10.900359 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:10.900255 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:08:46.576899 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.576818 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp"] Sep 17 18:08:46.577393 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.577069 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" containerID="cri-o://a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5" gracePeriod=30 Sep 17 18:08:46.577393 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.577088 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kube-rbac-proxy" containerID="cri-o://954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603" gracePeriod=30 Sep 17 18:08:46.619405 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.619373 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7"] Sep 17 18:08:46.619662 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.619639 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" containerID="cri-o://95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111" gracePeriod=30 Sep 17 18:08:46.619746 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.619703 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kube-rbac-proxy" containerID="cri-o://7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c" gracePeriod=30 Sep 17 18:08:46.656408 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.656375 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7"] Sep 17 18:08:46.656693 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.656615 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" containerID="cri-o://316e2326a07cb465c4ec09384619fbe505f764fd873df4d80299c18009781fd2" gracePeriod=30 Sep 17 18:08:46.656693 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.656643 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kube-rbac-proxy" containerID="cri-o://8bec27b3f9462506c258639bb4fb61dc562de8b76a6eb50dcb1ae347d0189a79" gracePeriod=30 Sep 17 18:08:46.900926 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:46.900872 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused" Sep 17 18:08:47.432524 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:47.432490 2582 generic.go:356] "Generic (PLEG): container finished" podID="aaecf815-c12f-412a-8e12-1f575a62d407" containerID="8bec27b3f9462506c258639bb4fb61dc562de8b76a6eb50dcb1ae347d0189a79" exitCode=2 Sep 17 18:08:47.432751 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:47.432556 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" event={"ID":"aaecf815-c12f-412a-8e12-1f575a62d407","Type":"ContainerDied","Data":"8bec27b3f9462506c258639bb4fb61dc562de8b76a6eb50dcb1ae347d0189a79"} Sep 17 18:08:47.434810 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:47.434790 2582 generic.go:356] "Generic (PLEG): container finished" podID="2a22771e-e020-452f-bd08-f618e31386f8" containerID="954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603" exitCode=2 Sep 17 18:08:47.434879 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:47.434860 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" event={"ID":"2a22771e-e020-452f-bd08-f618e31386f8","Type":"ContainerDied","Data":"954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603"} Sep 17 18:08:47.437011 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:47.436991 2582 generic.go:356] "Generic (PLEG): container finished" podID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerID="7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c" exitCode=2 Sep 17 18:08:47.437122 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:47.437032 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" event={"ID":"a18f7964-2bef-40e9-8a03-6e255ce79dc5","Type":"ContainerDied","Data":"7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c"} Sep 17 18:08:50.894980 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:50.894935 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused" Sep 17 18:08:50.895392 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:50.894943 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.25:8643/healthz\": dial tcp 10.134.0.25:8643: connect: connection refused" Sep 17 18:08:50.900369 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:50.900339 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 17 18:08:50.900441 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:50.900340 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused" Sep 17 18:08:51.458595 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.458539 2582 generic.go:356] "Generic (PLEG): container finished" podID="aaecf815-c12f-412a-8e12-1f575a62d407" containerID="316e2326a07cb465c4ec09384619fbe505f764fd873df4d80299c18009781fd2" exitCode=0 Sep 17 18:08:51.458757 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.458617 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" event={"ID":"aaecf815-c12f-412a-8e12-1f575a62d407","Type":"ContainerDied","Data":"316e2326a07cb465c4ec09384619fbe505f764fd873df4d80299c18009781fd2"} Sep 17 18:08:51.501677 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.501650 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:08:51.616114 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616016 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvgs2\" (UniqueName: \"kubernetes.io/projected/aaecf815-c12f-412a-8e12-1f575a62d407-kube-api-access-xvgs2\") pod \"aaecf815-c12f-412a-8e12-1f575a62d407\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " Sep 17 18:08:51.616114 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616065 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaecf815-c12f-412a-8e12-1f575a62d407-kserve-provision-location\") pod \"aaecf815-c12f-412a-8e12-1f575a62d407\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " Sep 17 18:08:51.616114 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616107 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaecf815-c12f-412a-8e12-1f575a62d407-proxy-tls\") pod \"aaecf815-c12f-412a-8e12-1f575a62d407\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " Sep 17 18:08:51.616407 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616213 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-kube-rbac-proxy-sar-config\") pod \"aaecf815-c12f-412a-8e12-1f575a62d407\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " Sep 17 18:08:51.616407 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616345 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-cabundle-cert\") pod \"aaecf815-c12f-412a-8e12-1f575a62d407\" (UID: \"aaecf815-c12f-412a-8e12-1f575a62d407\") " Sep 17 18:08:51.616514 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616442 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaecf815-c12f-412a-8e12-1f575a62d407-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "aaecf815-c12f-412a-8e12-1f575a62d407" (UID: "aaecf815-c12f-412a-8e12-1f575a62d407"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:08:51.616653 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616627 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "aaecf815-c12f-412a-8e12-1f575a62d407" (UID: "aaecf815-c12f-412a-8e12-1f575a62d407"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:08:51.616778 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616704 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "aaecf815-c12f-412a-8e12-1f575a62d407" (UID: "aaecf815-c12f-412a-8e12-1f575a62d407"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:08:51.616778 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616747 2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:51.616778 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.616760 2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aaecf815-c12f-412a-8e12-1f575a62d407-kserve-provision-location\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:51.618922 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.618900 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaecf815-c12f-412a-8e12-1f575a62d407-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "aaecf815-c12f-412a-8e12-1f575a62d407" (UID: "aaecf815-c12f-412a-8e12-1f575a62d407"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:08:51.619001 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.618903 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaecf815-c12f-412a-8e12-1f575a62d407-kube-api-access-xvgs2" (OuterVolumeSpecName: "kube-api-access-xvgs2") pod "aaecf815-c12f-412a-8e12-1f575a62d407" (UID: "aaecf815-c12f-412a-8e12-1f575a62d407"). InnerVolumeSpecName "kube-api-access-xvgs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:08:51.717977 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.717946 2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaecf815-c12f-412a-8e12-1f575a62d407-proxy-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:51.717977 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.717974 2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/aaecf815-c12f-412a-8e12-1f575a62d407-cabundle-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:51.717977 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.717983 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvgs2\" (UniqueName: \"kubernetes.io/projected/aaecf815-c12f-412a-8e12-1f575a62d407-kube-api-access-xvgs2\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:51.947975 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:51.947952 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:08:52.058352 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.058323 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:08:52.123119 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.123087 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2a22771e-e020-452f-bd08-f618e31386f8-proxy-tls\") pod \"2a22771e-e020-452f-bd08-f618e31386f8\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " Sep 17 18:08:52.123119 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.123128 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-cabundle-cert\") pod \"2a22771e-e020-452f-bd08-f618e31386f8\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " Sep 17 18:08:52.123373 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.123195 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlcnq\" (UniqueName: \"kubernetes.io/projected/2a22771e-e020-452f-bd08-f618e31386f8-kube-api-access-dlcnq\") pod \"2a22771e-e020-452f-bd08-f618e31386f8\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " Sep 17 18:08:52.123373 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.123240 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-kube-rbac-proxy-sar-config\") pod \"2a22771e-e020-452f-bd08-f618e31386f8\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " Sep 17 18:08:52.123373 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.123353 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a22771e-e020-452f-bd08-f618e31386f8-kserve-provision-location\") pod \"2a22771e-e020-452f-bd08-f618e31386f8\" (UID: \"2a22771e-e020-452f-bd08-f618e31386f8\") " Sep 17 18:08:52.123689 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.123663 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "2a22771e-e020-452f-bd08-f618e31386f8" (UID: "2a22771e-e020-452f-bd08-f618e31386f8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:08:52.123689 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.123668 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a22771e-e020-452f-bd08-f618e31386f8-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "2a22771e-e020-452f-bd08-f618e31386f8" (UID: "2a22771e-e020-452f-bd08-f618e31386f8"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:08:52.123689 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.123670 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "2a22771e-e020-452f-bd08-f618e31386f8" (UID: "2a22771e-e020-452f-bd08-f618e31386f8"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:08:52.125867 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.125846 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a22771e-e020-452f-bd08-f618e31386f8-kube-api-access-dlcnq" (OuterVolumeSpecName: "kube-api-access-dlcnq") pod "2a22771e-e020-452f-bd08-f618e31386f8" (UID: "2a22771e-e020-452f-bd08-f618e31386f8"). InnerVolumeSpecName "kube-api-access-dlcnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:08:52.125867 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.125848 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a22771e-e020-452f-bd08-f618e31386f8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2a22771e-e020-452f-bd08-f618e31386f8" (UID: "2a22771e-e020-452f-bd08-f618e31386f8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:08:52.224609 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.224504 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dprt7\" (UniqueName: \"kubernetes.io/projected/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-api-access-dprt7\") pod \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " Sep 17 18:08:52.224609 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.224598 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a18f7964-2bef-40e9-8a03-6e255ce79dc5-proxy-tls\") pod \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " Sep 17 18:08:52.224808 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.224763 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kserve-provision-location\") pod \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " Sep 17 18:08:52.224864 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.224853 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-rbac-proxy-sar-config\") pod \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " Sep 17 18:08:52.224922 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.224899 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-cabundle-cert\") pod \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\" (UID: \"a18f7964-2bef-40e9-8a03-6e255ce79dc5\") " Sep 17 18:08:52.225175 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.225084 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a18f7964-2bef-40e9-8a03-6e255ce79dc5" (UID: "a18f7964-2bef-40e9-8a03-6e255ce79dc5"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:08:52.225175 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.225134 2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.225351 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.225200 2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a22771e-e020-452f-bd08-f618e31386f8-kserve-provision-location\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.225351 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.225216 2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2a22771e-e020-452f-bd08-f618e31386f8-proxy-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.225351 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.225229 2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/2a22771e-e020-452f-bd08-f618e31386f8-cabundle-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.225351 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.225242 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlcnq\" (UniqueName: \"kubernetes.io/projected/2a22771e-e020-452f-bd08-f618e31386f8-kube-api-access-dlcnq\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.225351 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.225266 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a18f7964-2bef-40e9-8a03-6e255ce79dc5" (UID: "a18f7964-2bef-40e9-8a03-6e255ce79dc5"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:08:52.225351 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.225289 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a18f7964-2bef-40e9-8a03-6e255ce79dc5" (UID: "a18f7964-2bef-40e9-8a03-6e255ce79dc5"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:08:52.226822 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.226801 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a18f7964-2bef-40e9-8a03-6e255ce79dc5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a18f7964-2bef-40e9-8a03-6e255ce79dc5" (UID: "a18f7964-2bef-40e9-8a03-6e255ce79dc5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:08:52.226822 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.226811 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-api-access-dprt7" (OuterVolumeSpecName: "kube-api-access-dprt7") pod "a18f7964-2bef-40e9-8a03-6e255ce79dc5" (UID: "a18f7964-2bef-40e9-8a03-6e255ce79dc5"). InnerVolumeSpecName "kube-api-access-dprt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:08:52.326377 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.326338 2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a18f7964-2bef-40e9-8a03-6e255ce79dc5-proxy-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.326377 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.326370 2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kserve-provision-location\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.326377 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.326382 2582 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.326635 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.326396 2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a18f7964-2bef-40e9-8a03-6e255ce79dc5-cabundle-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.326635 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.326408 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dprt7\" (UniqueName: \"kubernetes.io/projected/a18f7964-2bef-40e9-8a03-6e255ce79dc5-kube-api-access-dprt7\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:08:52.464976 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.464939 2582 generic.go:356] "Generic (PLEG): container finished" podID="2a22771e-e020-452f-bd08-f618e31386f8" containerID="a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5" exitCode=0 Sep 17 18:08:52.465156 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.464998 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" Sep 17 18:08:52.465156 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.465021 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" event={"ID":"2a22771e-e020-452f-bd08-f618e31386f8","Type":"ContainerDied","Data":"a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5"} Sep 17 18:08:52.465156 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.465090 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp" event={"ID":"2a22771e-e020-452f-bd08-f618e31386f8","Type":"ContainerDied","Data":"ce762129d1d3858c1fc562db30e313128d4b9710cc1f2b1cadb269fb80896b34"} Sep 17 18:08:52.465156 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.465130 2582 scope.go:117] "RemoveContainer" containerID="954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603" Sep 17 18:08:52.467200 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.467172 2582 generic.go:356] "Generic (PLEG): container finished" podID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerID="95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111" exitCode=0 Sep 17 18:08:52.467312 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.467236 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" Sep 17 18:08:52.467312 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.467259 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" event={"ID":"a18f7964-2bef-40e9-8a03-6e255ce79dc5","Type":"ContainerDied","Data":"95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111"} Sep 17 18:08:52.467412 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.467319 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7" event={"ID":"a18f7964-2bef-40e9-8a03-6e255ce79dc5","Type":"ContainerDied","Data":"7d177bc2fb14c34ec5406b8f3010860777c52a3f5ca3f41b283b8afd0ce79ab6"} Sep 17 18:08:52.469445 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.469422 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" event={"ID":"aaecf815-c12f-412a-8e12-1f575a62d407","Type":"ContainerDied","Data":"de174956122d38cb61529f05cf97b311bae0791cf4bd81d58de133f4194e2ce1"} Sep 17 18:08:52.469570 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.469474 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7" Sep 17 18:08:52.475625 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.475557 2582 scope.go:117] "RemoveContainer" containerID="a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5" Sep 17 18:08:52.483881 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.483864 2582 scope.go:117] "RemoveContainer" containerID="dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289" Sep 17 18:08:52.487597 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.487549 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7"] Sep 17 18:08:52.490262 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.490234 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t74n7"] Sep 17 18:08:52.492187 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.492155 2582 scope.go:117] "RemoveContainer" containerID="954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603" Sep 17 18:08:52.492544 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:08:52.492517 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603\": container with ID starting with 954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603 not found: ID does not exist" containerID="954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603" Sep 17 18:08:52.492626 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.492543 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603"} err="failed to get container status \"954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603\": rpc error: code = NotFound desc = could not find container \"954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603\": container with ID starting with 954e75fe5f4c4cb378db0fa64040767f524fdc6a3e6f7f16dbf80ff050e82603 not found: ID does not exist" Sep 17 18:08:52.492626 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.492562 2582 scope.go:117] "RemoveContainer" containerID="a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5" Sep 17 18:08:52.492883 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:08:52.492862 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5\": container with ID starting with a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5 not found: ID does not exist" containerID="a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5" Sep 17 18:08:52.492943 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.492890 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5"} err="failed to get container status \"a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5\": rpc error: code = NotFound desc = could not find container \"a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5\": container with ID starting with a094aac3b24ffdb068d51e789fb463c0a56c158dae8001c48cc8b09a108eedb5 not found: ID does not exist" Sep 17 18:08:52.492943 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.492910 2582 scope.go:117] "RemoveContainer" containerID="dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289" Sep 17 18:08:52.493182 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:08:52.493162 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289\": container with ID starting with dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289 not found: ID does not exist" containerID="dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289" Sep 17 18:08:52.493235 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.493191 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289"} err="failed to get container status \"dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289\": rpc error: code = NotFound desc = could not find container \"dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289\": container with ID starting with dc080c6042fd99bd9fdd1078ce342feb0d86ceeeb26368bc3cc99fa5e6149289 not found: ID does not exist" Sep 17 18:08:52.493235 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.493207 2582 scope.go:117] "RemoveContainer" containerID="7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c" Sep 17 18:08:52.500851 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.500822 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7"] Sep 17 18:08:52.501753 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.501726 2582 scope.go:117] "RemoveContainer" containerID="95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111" Sep 17 18:08:52.508719 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.508694 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-8587dd57d4-hmdx7"] Sep 17 18:08:52.510755 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.510734 2582 scope.go:117] "RemoveContainer" containerID="377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b" Sep 17 18:08:52.519201 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.519180 2582 scope.go:117] "RemoveContainer" containerID="7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c" Sep 17 18:08:52.519520 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:08:52.519498 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c\": container with ID starting with 7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c not found: ID does not exist" containerID="7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c" Sep 17 18:08:52.519607 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.519529 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c"} err="failed to get container status \"7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c\": rpc error: code = NotFound desc = could not find container \"7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c\": container with ID starting with 7f8af26d064c0844a7b499cb9e6cec894e73f0b5aab2144d8dc3abd2dc326b5c not found: ID does not exist" Sep 17 18:08:52.519607 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.519553 2582 scope.go:117] "RemoveContainer" containerID="95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111" Sep 17 18:08:52.519863 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.519846 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp"] Sep 17 18:08:52.519919 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:08:52.519903 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111\": container with ID starting with 95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111 not found: ID does not exist" containerID="95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111" Sep 17 18:08:52.519959 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.519927 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111"} err="failed to get container status \"95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111\": rpc error: code = NotFound desc = could not find container \"95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111\": container with ID starting with 95ab990c480db811ed5f31e51b7f77c83298ae07b0adf658b8fd9185069f0111 not found: ID does not exist" Sep 17 18:08:52.519959 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.519943 2582 scope.go:117] "RemoveContainer" containerID="377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b" Sep 17 18:08:52.520209 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:08:52.520191 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b\": container with ID starting with 377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b not found: ID does not exist" containerID="377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b" Sep 17 18:08:52.520261 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.520212 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b"} err="failed to get container status \"377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b\": rpc error: code = NotFound desc = could not find container \"377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b\": container with ID starting with 377625b715246429db5f71aa490810741f8b46a27a66fb6e5f5e59b2a8d9663b not found: ID does not exist" Sep 17 18:08:52.520261 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.520227 2582 scope.go:117] "RemoveContainer" containerID="8bec27b3f9462506c258639bb4fb61dc562de8b76a6eb50dcb1ae347d0189a79" Sep 17 18:08:52.523831 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.523811 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-57f7556d97-gb7xp"] Sep 17 18:08:52.528133 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.528117 2582 scope.go:117] "RemoveContainer" containerID="316e2326a07cb465c4ec09384619fbe505f764fd873df4d80299c18009781fd2" Sep 17 18:08:52.535470 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:52.535454 2582 scope.go:117] "RemoveContainer" containerID="693de788c424b4c8d6f12864e609cd2f4f696cce7b2eabaf19f36bb603ea8ed8" Sep 17 18:08:54.083967 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:54.083936 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a22771e-e020-452f-bd08-f618e31386f8" path="/var/lib/kubelet/pods/2a22771e-e020-452f-bd08-f618e31386f8/volumes" Sep 17 18:08:54.084445 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:54.084432 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" path="/var/lib/kubelet/pods/a18f7964-2bef-40e9-8a03-6e255ce79dc5/volumes" Sep 17 18:08:54.085250 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:08:54.085234 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" path="/var/lib/kubelet/pods/aaecf815-c12f-412a-8e12-1f575a62d407/volumes" Sep 17 18:45:47.430552 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430507 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bplqr/must-gather-489hv"] Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430877 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430889 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430899 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kube-rbac-proxy" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430905 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kube-rbac-proxy" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430920 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430926 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430945 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="storage-initializer" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430951 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="storage-initializer" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430958 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="storage-initializer" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430963 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="storage-initializer" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430969 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430975 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430982 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kube-rbac-proxy" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430986 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kube-rbac-proxy" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.430994 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="storage-initializer" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.431000 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="storage-initializer" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.431006 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kube-rbac-proxy" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.431011 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kube-rbac-proxy" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.431064 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kube-rbac-proxy" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.431071 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kube-rbac-proxy" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.431079 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaecf815-c12f-412a-8e12-1f575a62d407" containerName="kserve-container" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.431084 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kserve-container" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.431090 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18f7964-2bef-40e9-8a03-6e255ce79dc5" containerName="kserve-container" Sep 17 18:45:47.433151 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.431095 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a22771e-e020-452f-bd08-f618e31386f8" containerName="kube-rbac-proxy" Sep 17 18:45:47.434022 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.434005 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:45:47.436297 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.436276 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bplqr\"/\"kube-root-ca.crt\"" Sep 17 18:45:47.436410 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.436391 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bplqr\"/\"openshift-service-ca.crt\"" Sep 17 18:45:47.436487 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.436475 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bplqr\"/\"default-dockercfg-h5r8c\"" Sep 17 18:45:47.440990 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.440960 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bplqr/must-gather-489hv"] Sep 17 18:45:47.533595 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.533541 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26fd2794-4e54-422f-9c96-707648b3b6a2-must-gather-output\") pod \"must-gather-489hv\" (UID: \"26fd2794-4e54-422f-9c96-707648b3b6a2\") " pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:45:47.533795 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.533674 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl6f4\" (UniqueName: \"kubernetes.io/projected/26fd2794-4e54-422f-9c96-707648b3b6a2-kube-api-access-xl6f4\") pod \"must-gather-489hv\" (UID: \"26fd2794-4e54-422f-9c96-707648b3b6a2\") " pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:45:47.634550 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.634495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26fd2794-4e54-422f-9c96-707648b3b6a2-must-gather-output\") pod \"must-gather-489hv\" (UID: \"26fd2794-4e54-422f-9c96-707648b3b6a2\") " pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:45:47.634772 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.634632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl6f4\" (UniqueName: \"kubernetes.io/projected/26fd2794-4e54-422f-9c96-707648b3b6a2-kube-api-access-xl6f4\") pod \"must-gather-489hv\" (UID: \"26fd2794-4e54-422f-9c96-707648b3b6a2\") " pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:45:47.634938 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.634916 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26fd2794-4e54-422f-9c96-707648b3b6a2-must-gather-output\") pod \"must-gather-489hv\" (UID: \"26fd2794-4e54-422f-9c96-707648b3b6a2\") " pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:45:47.642629 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.642569 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl6f4\" (UniqueName: \"kubernetes.io/projected/26fd2794-4e54-422f-9c96-707648b3b6a2-kube-api-access-xl6f4\") pod \"must-gather-489hv\" (UID: \"26fd2794-4e54-422f-9c96-707648b3b6a2\") " pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:45:47.754637 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:47.754522 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:45:48.026039 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:48.026007 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bplqr/must-gather-489hv"] Sep 17 18:45:48.028839 ip-10-0-135-240 kubenswrapper[2582]: W0917 18:45:48.028799 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26fd2794_4e54_422f_9c96_707648b3b6a2.slice/crio-87c451a0e3a4eb09a6a15cd309fe36a8d7af2398ef6f95a1f5e70904403317e2 WatchSource:0}: Error finding container 87c451a0e3a4eb09a6a15cd309fe36a8d7af2398ef6f95a1f5e70904403317e2: Status 404 returned error can't find the container with id 87c451a0e3a4eb09a6a15cd309fe36a8d7af2398ef6f95a1f5e70904403317e2 Sep 17 18:45:48.031022 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:48.031000 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 18:45:48.805636 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:48.805554 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bplqr/must-gather-489hv" event={"ID":"26fd2794-4e54-422f-9c96-707648b3b6a2","Type":"ContainerStarted","Data":"87c451a0e3a4eb09a6a15cd309fe36a8d7af2398ef6f95a1f5e70904403317e2"} Sep 17 18:45:54.838792 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:54.838746 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bplqr/must-gather-489hv" event={"ID":"26fd2794-4e54-422f-9c96-707648b3b6a2","Type":"ContainerStarted","Data":"9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96"} Sep 17 18:45:54.839338 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:54.839296 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bplqr/must-gather-489hv" event={"ID":"26fd2794-4e54-422f-9c96-707648b3b6a2","Type":"ContainerStarted","Data":"8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a"} Sep 17 18:45:54.854076 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:45:54.854014 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bplqr/must-gather-489hv" podStartSLOduration=1.761634998 podStartE2EDuration="7.853993204s" totalImagesPullingTime="6.092358206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:45:54.853027915 +0000 UTC m=+2942.998953096" watchObservedRunningTime="2026-09-17 18:45:54.853993204 +0000 UTC m=+2942.999918381" Sep 17 18:46:17.953777 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:17.953739 2582 generic.go:356] "Generic (PLEG): container finished" podID="26fd2794-4e54-422f-9c96-707648b3b6a2" containerID="8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a" exitCode=0 Sep 17 18:46:17.954242 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:17.953811 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bplqr/must-gather-489hv" event={"ID":"26fd2794-4e54-422f-9c96-707648b3b6a2","Type":"ContainerDied","Data":"8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a"} Sep 17 18:46:17.954242 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:17.954121 2582 scope.go:117] "RemoveContainer" containerID="8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a" Sep 17 18:46:18.269312 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:18.269221 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bplqr_must-gather-489hv_26fd2794-4e54-422f-9c96-707648b3b6a2/gather/0.log" Sep 17 18:46:21.570704 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:21.570663 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gds4r_557e8783-4dae-46ee-be7e-90e81efe69d7/global-pull-secret-syncer/0.log" Sep 17 18:46:21.720112 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:21.720081 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6tjqt_e8078e46-08b4-42dc-b26c-4c641ead8339/konnectivity-agent/0.log" Sep 17 18:46:21.839144 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:21.839058 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-240.ec2.internal_04ddfa7d8805c056a864c45acb85b2eb/haproxy/0.log" Sep 17 18:46:23.685546 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.685508 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-bplqr/must-gather-489hv"] Sep 17 18:46:23.686122 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.685704 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-bplqr/must-gather-489hv" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" containerName="copy" containerID="cri-o://9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96" gracePeriod=2 Sep 17 18:46:23.690021 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.689342 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-bplqr/must-gather-489hv"] Sep 17 18:46:23.921313 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.921291 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bplqr_must-gather-489hv_26fd2794-4e54-422f-9c96-707648b3b6a2/copy/0.log" Sep 17 18:46:23.922860 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.922841 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:46:23.924402 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:46:23.924379 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-489hv\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bplqr\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:46:23.989416 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.989320 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bplqr_must-gather-489hv_26fd2794-4e54-422f-9c96-707648b3b6a2/copy/0.log" Sep 17 18:46:23.989763 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.989736 2582 generic.go:356] "Generic (PLEG): container finished" podID="26fd2794-4e54-422f-9c96-707648b3b6a2" containerID="9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96" exitCode=143 Sep 17 18:46:23.989846 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.989785 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:46:23.989846 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.989830 2582 scope.go:117] "RemoveContainer" containerID="9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96" Sep 17 18:46:23.991533 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:46:23.991504 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-489hv\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bplqr\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:46:23.997687 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:23.997668 2582 scope.go:117] "RemoveContainer" containerID="8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a" Sep 17 18:46:24.010695 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.010669 2582 scope.go:117] "RemoveContainer" containerID="9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96" Sep 17 18:46:24.011006 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:46:24.010988 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96\": container with ID starting with 9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96 not found: ID does not exist" containerID="9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96" Sep 17 18:46:24.011065 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.011017 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96"} err="failed to get container status \"9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96\": rpc error: code = NotFound desc = could not find container \"9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96\": container with ID starting with 9a50725c6f896834a41ee019ecba97a2c79e3a3b204308e521c5bac363fb0b96 not found: ID does not exist" Sep 17 18:46:24.011065 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.011034 2582 scope.go:117] "RemoveContainer" containerID="8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a" Sep 17 18:46:24.011331 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:46:24.011311 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a\": container with ID starting with 8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a not found: ID does not exist" containerID="8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a" Sep 17 18:46:24.011377 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.011338 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a"} err="failed to get container status \"8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a\": rpc error: code = NotFound desc = could not find container \"8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a\": container with ID starting with 8ab2f28caff380aa8340e0ac7b8c76909ec5719fe73a7e977a4b7bcdc2aaa57a not found: ID does not exist" Sep 17 18:46:24.066492 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.066449 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl6f4\" (UniqueName: \"kubernetes.io/projected/26fd2794-4e54-422f-9c96-707648b3b6a2-kube-api-access-xl6f4\") pod \"26fd2794-4e54-422f-9c96-707648b3b6a2\" (UID: \"26fd2794-4e54-422f-9c96-707648b3b6a2\") " Sep 17 18:46:24.066713 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.066509 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26fd2794-4e54-422f-9c96-707648b3b6a2-must-gather-output\") pod \"26fd2794-4e54-422f-9c96-707648b3b6a2\" (UID: \"26fd2794-4e54-422f-9c96-707648b3b6a2\") " Sep 17 18:46:24.068097 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.068071 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26fd2794-4e54-422f-9c96-707648b3b6a2-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "26fd2794-4e54-422f-9c96-707648b3b6a2" (UID: "26fd2794-4e54-422f-9c96-707648b3b6a2"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:46:24.068798 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.068770 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fd2794-4e54-422f-9c96-707648b3b6a2-kube-api-access-xl6f4" (OuterVolumeSpecName: "kube-api-access-xl6f4") pod "26fd2794-4e54-422f-9c96-707648b3b6a2" (UID: "26fd2794-4e54-422f-9c96-707648b3b6a2"). InnerVolumeSpecName "kube-api-access-xl6f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:46:24.081753 ip-10-0-135-240 kubenswrapper[2582]: E0917 18:46:24.081712 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-489hv\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bplqr\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" pod="openshift-must-gather-bplqr/must-gather-489hv" Sep 17 18:46:24.083587 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.083557 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" path="/var/lib/kubelet/pods/26fd2794-4e54-422f-9c96-707648b3b6a2/volumes" Sep 17 18:46:24.168128 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.167948 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl6f4\" (UniqueName: \"kubernetes.io/projected/26fd2794-4e54-422f-9c96-707648b3b6a2-kube-api-access-xl6f4\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:46:24.168128 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:24.167982 2582 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26fd2794-4e54-422f-9c96-707648b3b6a2-must-gather-output\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Sep 17 18:46:25.852988 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:25.852957 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89433528-3d6e-45c4-949e-14cc9766b7dd/alertmanager/0.log" Sep 17 18:46:25.884194 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:25.884169 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89433528-3d6e-45c4-949e-14cc9766b7dd/config-reloader/0.log" Sep 17 18:46:25.907285 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:25.907258 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89433528-3d6e-45c4-949e-14cc9766b7dd/kube-rbac-proxy-web/0.log" Sep 17 18:46:25.929519 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:25.929487 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89433528-3d6e-45c4-949e-14cc9766b7dd/kube-rbac-proxy/0.log" Sep 17 18:46:25.952990 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:25.952965 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89433528-3d6e-45c4-949e-14cc9766b7dd/kube-rbac-proxy-metric/0.log" Sep 17 18:46:25.975563 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:25.975531 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89433528-3d6e-45c4-949e-14cc9766b7dd/prom-label-proxy/0.log" Sep 17 18:46:26.004509 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.004482 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_89433528-3d6e-45c4-949e-14cc9766b7dd/init-config-reloader/0.log" Sep 17 18:46:26.075132 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.075048 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-2n9hm_6408376b-ba97-4a54-9a72-3ddc899d7f10/kube-state-metrics/0.log" Sep 17 18:46:26.095051 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.095022 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-2n9hm_6408376b-ba97-4a54-9a72-3ddc899d7f10/kube-rbac-proxy-main/0.log" Sep 17 18:46:26.118218 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.118173 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-2n9hm_6408376b-ba97-4a54-9a72-3ddc899d7f10/kube-rbac-proxy-self/0.log" Sep 17 18:46:26.200461 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.200428 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4kzgr_8b28c106-1996-41fe-8936-9392942531f0/node-exporter/0.log" Sep 17 18:46:26.225987 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.225956 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4kzgr_8b28c106-1996-41fe-8936-9392942531f0/kube-rbac-proxy/0.log" Sep 17 18:46:26.254067 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.254043 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4kzgr_8b28c106-1996-41fe-8936-9392942531f0/init-textfile/0.log" Sep 17 18:46:26.461235 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.461202 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-8lm82_f7ade46e-b47c-400d-a301-c89fa02dad4b/kube-rbac-proxy-main/0.log" Sep 17 18:46:26.485752 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.485723 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-8lm82_f7ade46e-b47c-400d-a301-c89fa02dad4b/kube-rbac-proxy-self/0.log" Sep 17 18:46:26.509103 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.509077 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-8lm82_f7ade46e-b47c-400d-a301-c89fa02dad4b/openshift-state-metrics/0.log" Sep 17 18:46:26.550705 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.550658 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ceb2215f-bed0-42d2-867b-a5ec1f04f0c7/prometheus/0.log" Sep 17 18:46:26.572568 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.572534 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ceb2215f-bed0-42d2-867b-a5ec1f04f0c7/config-reloader/0.log" Sep 17 18:46:26.593944 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.593918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ceb2215f-bed0-42d2-867b-a5ec1f04f0c7/thanos-sidecar/0.log" Sep 17 18:46:26.616267 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.616235 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ceb2215f-bed0-42d2-867b-a5ec1f04f0c7/kube-rbac-proxy-web/0.log" Sep 17 18:46:26.647822 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.647782 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ceb2215f-bed0-42d2-867b-a5ec1f04f0c7/kube-rbac-proxy/0.log" Sep 17 18:46:26.673278 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.673246 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ceb2215f-bed0-42d2-867b-a5ec1f04f0c7/kube-rbac-proxy-thanos/0.log" Sep 17 18:46:26.695644 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.695618 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ceb2215f-bed0-42d2-867b-a5ec1f04f0c7/init-config-reloader/0.log" Sep 17 18:46:26.779614 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.779510 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-cr2hw_96e6b629-ffda-4b8e-9fc8-dd9f2afac6bb/prometheus-operator-admission-webhook/0.log" Sep 17 18:46:26.808541 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.808515 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566564c77-xng25_9a792eed-8e87-40fb-91a0-daf235a3be2a/telemeter-client/0.log" Sep 17 18:46:26.831188 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.831157 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566564c77-xng25_9a792eed-8e87-40fb-91a0-daf235a3be2a/reload/0.log" Sep 17 18:46:26.863314 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.863291 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566564c77-xng25_9a792eed-8e87-40fb-91a0-daf235a3be2a/kube-rbac-proxy/0.log" Sep 17 18:46:26.895704 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.895673 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bf6db65f-fh8qn_8b490a09-01f5-458c-abe9-5f1470b303f8/thanos-query/0.log" Sep 17 18:46:26.926506 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.926479 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bf6db65f-fh8qn_8b490a09-01f5-458c-abe9-5f1470b303f8/kube-rbac-proxy-web/0.log" Sep 17 18:46:26.946965 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.946941 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bf6db65f-fh8qn_8b490a09-01f5-458c-abe9-5f1470b303f8/kube-rbac-proxy/0.log" Sep 17 18:46:26.975147 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.975117 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bf6db65f-fh8qn_8b490a09-01f5-458c-abe9-5f1470b303f8/prom-label-proxy/0.log" Sep 17 18:46:26.992631 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:26.992603 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bf6db65f-fh8qn_8b490a09-01f5-458c-abe9-5f1470b303f8/kube-rbac-proxy-rules/0.log" Sep 17 18:46:27.017759 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:27.017736 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9bf6db65f-fh8qn_8b490a09-01f5-458c-abe9-5f1470b303f8/kube-rbac-proxy-metrics/0.log" Sep 17 18:46:28.364719 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:28.364644 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-z8mzt_6673fd94-fa13-4b71-b8a5-7244a365f0c9/networking-console-plugin/0.log" Sep 17 18:46:29.672068 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.672030 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4"] Sep 17 18:46:29.672564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.672434 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" containerName="copy" Sep 17 18:46:29.672564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.672445 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" containerName="copy" Sep 17 18:46:29.672564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.672464 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" containerName="gather" Sep 17 18:46:29.672564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.672470 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" containerName="gather" Sep 17 18:46:29.672564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.672522 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" containerName="copy" Sep 17 18:46:29.672564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.672533 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fd2794-4e54-422f-9c96-707648b3b6a2" containerName="gather" Sep 17 18:46:29.674733 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.674717 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.676917 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.676893 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bs2q6\"/\"openshift-service-ca.crt\"" Sep 17 18:46:29.677049 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.676897 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bs2q6\"/\"default-dockercfg-5rqxp\"" Sep 17 18:46:29.677505 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.677485 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bs2q6\"/\"kube-root-ca.crt\"" Sep 17 18:46:29.682769 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.682744 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4"] Sep 17 18:46:29.820718 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.820679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-proc\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.820885 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.820792 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-lib-modules\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.820885 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.820826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-podres\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.820957 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.820889 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wxbc\" (UniqueName: \"kubernetes.io/projected/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-kube-api-access-6wxbc\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.820957 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.820906 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-sys\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.860340 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.860316 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-rhb9c_4b4011ea-4ae7-479f-a040-58b7efb07007/volume-data-source-validator/0.log" Sep 17 18:46:29.922413 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.922322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-proc\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.922564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.922414 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-lib-modules\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.922564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.922433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-podres\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.922564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.922451 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-proc\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.922564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.922472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wxbc\" (UniqueName: \"kubernetes.io/projected/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-kube-api-access-6wxbc\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.922564 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.922499 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-sys\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.922779 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.922604 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-podres\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.922779 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.922601 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-sys\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.922779 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.922610 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-lib-modules\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.930888 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.930860 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wxbc\" (UniqueName: \"kubernetes.io/projected/b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f-kube-api-access-6wxbc\") pod \"perf-node-gather-daemonset-p28l4\" (UID: \"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:29.985769 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:29.985729 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:30.257567 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:30.257525 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4"] Sep 17 18:46:30.260592 ip-10-0-135-240 kubenswrapper[2582]: W0917 18:46:30.260549 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb6eea806_d0ec_4fd4_8c35_ba8a0dd4a23f.slice/crio-b414704bb4960ef1088d75ccb94ed54b750b021ead1c326fb15b103792c96ef2 WatchSource:0}: Error finding container b414704bb4960ef1088d75ccb94ed54b750b021ead1c326fb15b103792c96ef2: Status 404 returned error can't find the container with id b414704bb4960ef1088d75ccb94ed54b750b021ead1c326fb15b103792c96ef2 Sep 17 18:46:30.844572 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:30.844540 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vtwcr_7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d/dns/0.log" Sep 17 18:46:30.867225 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:30.867195 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vtwcr_7e0e86bf-c94e-4e3d-8bc1-f1dcfe474e0d/kube-rbac-proxy/0.log" Sep 17 18:46:30.893517 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:30.893483 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-62ddv_b0baf25a-1695-4bef-8be0-42ac37b5d7fe/dns-node-resolver/0.log" Sep 17 18:46:31.023299 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:31.023263 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" event={"ID":"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f","Type":"ContainerStarted","Data":"1bb36a2af0fb1a8d1292db86c79ca1744b9b117cba8d5631cef9a7312d99b1e7"} Sep 17 18:46:31.023501 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:31.023320 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" event={"ID":"b6eea806-d0ec-4fd4-8c35-ba8a0dd4a23f","Type":"ContainerStarted","Data":"b414704bb4960ef1088d75ccb94ed54b750b021ead1c326fb15b103792c96ef2"} Sep 17 18:46:31.023501 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:31.023383 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:31.042482 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:31.042432 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" podStartSLOduration=2.042416149 podStartE2EDuration="2.042416149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:46:31.040760189 +0000 UTC m=+2979.186685366" watchObservedRunningTime="2026-09-17 18:46:31.042416149 +0000 UTC m=+2979.188341324" Sep 17 18:46:31.437145 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:31.437107 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9l9j6_8fda8510-3a22-4893-85e3-6f8d335a90bd/node-ca/0.log" Sep 17 18:46:32.190450 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:32.190421 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76698fc49b-lhzw4_3af0452f-d7f2-4ae5-8dfe-21a19c90350f/router/0.log" Sep 17 18:46:32.515649 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:32.515549 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5755p_67baaaa3-da8b-46d9-9aeb-81d826aee966/serve-healthcheck-canary/0.log" Sep 17 18:46:32.932085 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:32.932058 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79bsj_76bd7a97-6224-4ece-9971-a717c07cac25/kube-rbac-proxy/0.log" Sep 17 18:46:32.954192 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:32.954167 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79bsj_76bd7a97-6224-4ece-9971-a717c07cac25/exporter/0.log" Sep 17 18:46:32.975017 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:32.974992 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79bsj_76bd7a97-6224-4ece-9971-a717c07cac25/extractor/0.log" Sep 17 18:46:35.512937 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:35.512905 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-6xf5m_84506595-1c65-4ad8-991c-15a13d0b5df6/s3-init/0.log" Sep 17 18:46:35.527490 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:35.527470 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-6xf5m_84506595-1c65-4ad8-991c-15a13d0b5df6/download-hf-model/0.log" Sep 17 18:46:37.037854 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:37.037829 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-p28l4" Sep 17 18:46:39.742535 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:39.742509 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-xgclq_b8baa213-afcc-4387-92c0-f47badd76ed5/migrator/0.log" Sep 17 18:46:39.762751 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:39.762731 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-xgclq_b8baa213-afcc-4387-92c0-f47badd76ed5/graceful-termination/0.log" Sep 17 18:46:40.064051 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:40.063979 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-djg9j_759df245-a0e6-4cc0-8440-ac29949a4a99/kube-storage-version-migrator-operator/1.log" Sep 17 18:46:40.064761 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:40.064745 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-djg9j_759df245-a0e6-4cc0-8440-ac29949a4a99/kube-storage-version-migrator-operator/0.log" Sep 17 18:46:41.266860 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.266838 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v98r_91a5d860-8eb5-4edf-bd3f-00a9cc80c43d/kube-multus-additional-cni-plugins/0.log" Sep 17 18:46:41.287213 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.287192 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v98r_91a5d860-8eb5-4edf-bd3f-00a9cc80c43d/egress-router-binary-copy/0.log" Sep 17 18:46:41.309737 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.309696 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v98r_91a5d860-8eb5-4edf-bd3f-00a9cc80c43d/cni-plugins/0.log" Sep 17 18:46:41.346360 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.346346 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v98r_91a5d860-8eb5-4edf-bd3f-00a9cc80c43d/bond-cni-plugin/0.log" Sep 17 18:46:41.367403 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.367381 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v98r_91a5d860-8eb5-4edf-bd3f-00a9cc80c43d/routeoverride-cni/0.log" Sep 17 18:46:41.388536 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.388494 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v98r_91a5d860-8eb5-4edf-bd3f-00a9cc80c43d/whereabouts-cni-bincopy/0.log" Sep 17 18:46:41.409404 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.409378 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v98r_91a5d860-8eb5-4edf-bd3f-00a9cc80c43d/whereabouts-cni/0.log" Sep 17 18:46:41.618388 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.618306 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f6bj5_449e669f-ccb6-4110-ac97-c540212b87ed/kube-multus/0.log" Sep 17 18:46:41.707308 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.707281 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l2wd2_6dd258db-1cff-4db7-a043-b3505b84dfb7/network-metrics-daemon/0.log" Sep 17 18:46:41.728953 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:41.728918 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l2wd2_6dd258db-1cff-4db7-a043-b3505b84dfb7/kube-rbac-proxy/0.log" Sep 17 18:46:42.485512 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:42.485480 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8lhr7_a7242ee7-5eb4-4b53-97af-f6f84dc3374d/ovn-controller/0.log" Sep 17 18:46:42.506808 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:42.506762 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8lhr7_a7242ee7-5eb4-4b53-97af-f6f84dc3374d/ovn-acl-logging/0.log" Sep 17 18:46:42.530144 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:42.530120 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8lhr7_a7242ee7-5eb4-4b53-97af-f6f84dc3374d/kube-rbac-proxy-node/0.log" Sep 17 18:46:42.552297 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:42.552277 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8lhr7_a7242ee7-5eb4-4b53-97af-f6f84dc3374d/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 18:46:42.571975 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:42.571956 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8lhr7_a7242ee7-5eb4-4b53-97af-f6f84dc3374d/northd/0.log" Sep 17 18:46:42.592977 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:42.592946 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8lhr7_a7242ee7-5eb4-4b53-97af-f6f84dc3374d/nbdb/0.log" Sep 17 18:46:42.613405 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:42.613327 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8lhr7_a7242ee7-5eb4-4b53-97af-f6f84dc3374d/sbdb/0.log" Sep 17 18:46:42.649340 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:42.649321 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8lhr7_a7242ee7-5eb4-4b53-97af-f6f84dc3374d/ovnkube-controller/0.log" Sep 17 18:46:44.181162 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:44.181135 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nqzkc_eb1b686e-ca96-4296-8060-b1ecda60929d/network-check-target-container/0.log" Sep 17 18:46:45.122299 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:45.122275 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8624r_54947b01-7381-4b3b-9b6a-768c4b771671/iptables-alerter/0.log" Sep 17 18:46:45.914737 ip-10-0-135-240 kubenswrapper[2582]: I0917 18:46:45.914711 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-p6nzs_970df45c-7b47-4c5d-ab8b-95daf1604734/tuned/0.log"