Sep 17 08:22:13.449337 ip-10-0-140-148 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 08:22:13.449347 ip-10-0-140-148 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 08:22:13.449354 ip-10-0-140-148 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 08:22:13.449514 ip-10-0-140-148 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 08:22:23.657301 ip-10-0-140-148 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 08:22:23.657318 ip-10-0-140-148 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1070941296014762aa4a22b9706ca6fd -- Sep 17 08:24:03.185579 ip-10-0-140-148 systemd[1]: Starting Kubernetes Kubelet... Sep 17 08:24:03.577555 ip-10-0-140-148 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 08:24:03.577555 ip-10-0-140-148 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 08:24:03.577555 ip-10-0-140-148 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 08:24:03.577555 ip-10-0-140-148 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 08:24:03.577555 ip-10-0-140-148 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 08:24:03.579749 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.579541 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 08:24:03.586994 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.586971 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 08:24:03.586994 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.586990 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 08:24:03.586994 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.586994 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 08:24:03.586994 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.586997 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 08:24:03.586994 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587000 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587003 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587007 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587010 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587013 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587017 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587021 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587024 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587027 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587030 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587033 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587036 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587039 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587041 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587045 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587048 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587052 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587055 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587058 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 08:24:03.587198 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587069 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587072 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587075 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587078 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587081 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587084 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587087 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587090 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587093 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587096 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587098 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587101 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587104 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587106 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587108 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587112 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587114 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587117 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587120 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 08:24:03.587674 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587123 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587126 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587129 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587140 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587144 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587147 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587150 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587152 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587156 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587158 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587161 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587163 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587166 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587168 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587171 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587173 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587176 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587178 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587180 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587183 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 08:24:03.588128 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587185 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587188 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587190 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587192 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587195 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587198 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587200 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587203 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587206 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587209 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587211 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587214 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587216 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587219 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587221 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587225 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587228 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587230 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587232 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587235 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 08:24:03.588664 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587237 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587240 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587243 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587245 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587247 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587250 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587252 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587255 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587257 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587259 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587262 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587264 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587266 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587269 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587271 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587273 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587276 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587966 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587973 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587976 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 08:24:03.589145 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587980 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587983 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587986 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587988 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587991 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587994 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587997 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.587999 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588002 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588005 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588007 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588010 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588012 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588014 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588017 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588020 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588023 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588025 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588028 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588030 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 08:24:03.589644 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588033 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588035 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588037 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588041 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588045 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588048 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588051 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588054 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588056 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588059 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588061 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588064 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588067 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588070 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588073 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588075 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588078 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588080 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588083 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588085 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 08:24:03.590141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588087 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588090 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588092 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588095 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588097 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588099 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588102 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588105 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588107 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588109 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588112 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588114 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588117 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588119 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588121 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588124 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588126 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588129 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588131 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 08:24:03.590721 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588134 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588136 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588139 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588141 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588145 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588148 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588151 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588155 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588158 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588161 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588164 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588167 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588169 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588172 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588175 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588178 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588182 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588184 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588187 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 08:24:03.591194 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588189 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588192 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588195 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588197 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588200 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588202 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588205 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588207 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588209 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588212 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588214 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588217 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588220 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588223 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588225 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588228 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588230 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588232 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588638 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588644 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 08:24:03.591659 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588646 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588649 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588654 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588657 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588660 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588663 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588665 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588668 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588671 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588674 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588678 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588681 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588684 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588687 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588690 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588693 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588695 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588698 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588700 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 08:24:03.592141 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588703 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588705 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588708 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588710 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588713 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588715 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588718 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588720 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588723 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588725 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588727 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588731 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588733 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588736 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588738 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588741 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588743 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588746 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588749 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588751 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 08:24:03.592614 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588754 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588756 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588759 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588761 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588764 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588766 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588768 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588771 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588774 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588776 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588778 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588781 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588783 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588785 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588788 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588790 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588793 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588795 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588797 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588800 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 08:24:03.593098 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588802 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588804 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588807 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588810 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588813 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588816 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588818 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588821 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588823 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588825 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588828 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588830 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588834 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588837 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588840 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588843 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588846 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588848 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588851 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 08:24:03.593630 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588854 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588856 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588859 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588862 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588864 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588866 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588869 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588871 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588874 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588877 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588880 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588882 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588885 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588887 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588890 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588892 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588895 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588898 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.588901 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.588973 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589005 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 08:24:03.594085 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589013 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589017 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589021 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589024 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589028 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589032 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589035 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589038 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589041 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589044 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589047 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589049 2580 flags.go:64] FLAG: --cgroup-root="" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589052 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589055 2580 flags.go:64] FLAG: --client-ca-file="" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589058 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589061 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589065 2580 flags.go:64] FLAG: --cluster-domain="" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589067 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589070 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589073 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589076 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589080 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589082 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 08:24:03.594599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589085 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589088 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589091 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589094 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589097 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589100 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589103 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589107 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589109 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589112 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589115 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589118 2580 flags.go:64] FLAG: --enable-server="true" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589120 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589125 2580 flags.go:64] FLAG: --event-burst="100" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589128 2580 flags.go:64] FLAG: --event-qps="50" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589130 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589133 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589136 2580 flags.go:64] FLAG: --eviction-hard="" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589139 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589142 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589145 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589149 2580 flags.go:64] FLAG: --eviction-soft="" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589151 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589154 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589160 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 08:24:03.595178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589163 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589166 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589168 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589171 2580 flags.go:64] FLAG: --feature-gates="" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589175 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589178 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589180 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589183 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589186 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589189 2580 flags.go:64] FLAG: --help="false" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589192 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-140-148.ec2.internal" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589197 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589200 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589203 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589206 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589210 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589213 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589215 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589218 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589221 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589224 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589227 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589230 2580 flags.go:64] FLAG: --kube-reserved="" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589233 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 08:24:03.595814 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589235 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589238 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589241 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589243 2580 flags.go:64] FLAG: --lock-file="" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589246 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589249 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589251 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589257 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589260 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589263 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589265 2580 flags.go:64] FLAG: --logging-format="text" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589268 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589271 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589274 2580 flags.go:64] FLAG: --manifest-url="" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589277 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589281 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589284 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589288 2580 flags.go:64] FLAG: --max-pods="110" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589291 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589295 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589312 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589316 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589318 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589321 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589324 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 08:24:03.596414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589331 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589334 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589337 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589340 2580 flags.go:64] FLAG: --pod-cidr="" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589343 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589348 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589351 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589354 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589357 2580 flags.go:64] FLAG: --port="10250" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589360 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589363 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05d401c055670a266" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589366 2580 flags.go:64] FLAG: --qos-reserved="" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589369 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589372 2580 flags.go:64] FLAG: --register-node="true" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589374 2580 flags.go:64] FLAG: --register-with-taints="" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589378 2580 flags.go:64] FLAG: --registry-burst="10" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589381 2580 flags.go:64] FLAG: --registry-qps="5" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589384 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589387 2580 flags.go:64] FLAG: --reserved-memory="" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589390 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589393 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589396 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589399 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589402 2580 flags.go:64] FLAG: --runonce="false" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589405 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 08:24:03.597072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589408 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589412 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589415 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589417 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589420 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589424 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589427 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589430 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589432 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589435 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589438 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589441 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589443 2580 flags.go:64] FLAG: --system-cgroups="" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589446 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589451 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589454 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589456 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589460 2580 flags.go:64] FLAG: --tls-min-version="" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589463 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589465 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589468 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589472 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589475 2580 flags.go:64] FLAG: --v="2" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589480 2580 flags.go:64] FLAG: --version="false" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589488 2580 flags.go:64] FLAG: --vmodule="" Sep 17 08:24:03.597723 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589492 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.589495 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589604 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589608 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589611 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589614 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589617 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589620 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589623 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589626 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589628 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589631 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589633 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589636 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589639 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589641 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589644 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589646 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589649 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589652 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 08:24:03.598342 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589655 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589657 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589660 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589662 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589665 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589668 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589670 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589673 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589678 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589681 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589684 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589687 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589690 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589693 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589696 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589698 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589701 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589703 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589706 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 08:24:03.598832 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589708 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589712 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589715 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589717 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589720 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589722 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589725 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589727 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589730 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589732 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589735 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589737 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589740 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589742 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589745 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589747 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589750 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589752 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589755 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589757 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 08:24:03.599290 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589761 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589766 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589768 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589772 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589774 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589777 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589780 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589783 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589785 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589788 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589790 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589793 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589795 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589799 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589801 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589804 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589806 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589809 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589811 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589814 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 08:24:03.599794 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589816 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589819 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589821 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589824 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589827 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589829 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589831 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589834 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589836 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589840 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589844 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589846 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589849 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589852 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589855 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589857 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589860 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589862 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589865 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 08:24:03.600355 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589868 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589870 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.589872 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.590538 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.598401 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.598415 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.599327 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.599335 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599392 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599397 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599400 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599403 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599406 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599409 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 08:24:03.600816 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599412 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599415 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599419 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599421 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599424 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599427 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599430 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599433 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599435 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599438 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599442 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599446 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599449 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599452 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599454 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599457 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599459 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599462 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599464 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599467 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 08:24:03.601165 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599470 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599472 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599475 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599479 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599482 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599485 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599488 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599490 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599493 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599495 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599498 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599500 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599503 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599505 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599507 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599510 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599512 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599515 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599517 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599520 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 08:24:03.601689 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599523 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599525 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599528 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599530 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599533 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599535 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599537 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599540 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599542 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599544 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599547 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599549 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599552 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599554 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599557 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599559 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599563 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599565 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599568 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599571 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 08:24:03.602166 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599573 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599576 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599578 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599580 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599583 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599585 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599588 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599590 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599593 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599595 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599598 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599601 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599604 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599608 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599611 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599614 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599617 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599619 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599622 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599624 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 08:24:03.602657 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599627 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599629 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599632 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599634 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599637 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599640 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599642 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599645 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599647 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599652 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599655 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599658 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599661 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.599666 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599775 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 08:24:03.603147 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599780 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599783 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599786 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599788 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599791 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599793 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599796 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599798 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599801 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599804 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599806 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599809 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599811 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599814 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599816 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599819 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599821 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599823 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599826 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599828 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 08:24:03.603533 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599831 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599834 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599836 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599839 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599842 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599845 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599848 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599851 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599853 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599856 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599858 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599860 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599863 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599865 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599868 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599870 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599873 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599875 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599877 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599880 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 08:24:03.604017 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599882 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599886 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599890 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599892 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599896 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599898 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599901 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599904 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599907 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599909 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599912 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599915 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599917 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599920 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599923 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599926 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599929 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599932 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599935 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 08:24:03.604521 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599937 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599940 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599943 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599945 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599948 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599950 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599953 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599955 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599957 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599960 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599963 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599965 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599968 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599970 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599973 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599975 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599977 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599980 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599982 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599985 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 08:24:03.604976 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599987 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599989 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599992 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599994 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599996 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.599999 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600001 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600003 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600006 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600011 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600015 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600018 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600020 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600023 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600026 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600029 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600031 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600035 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 08:24:03.605564 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:03.600038 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 08:24:03.606031 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.600043 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 08:24:03.606031 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.600143 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 08:24:03.606031 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.602513 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 08:24:03.606031 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.603579 2580 server.go:1019] "Starting client certificate rotation" Sep 17 08:24:03.606031 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.603683 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 08:24:03.606031 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.603719 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 08:24:03.607199 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.607184 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 08:24:03.616352 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.616327 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 08:24:03.626974 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.626957 2580 log.go:25] "Validated CRI v1 runtime API" Sep 17 08:24:03.630275 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.630258 2580 log.go:25] "Validated CRI v1 image API" Sep 17 08:24:03.631038 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.631016 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 08:24:03.633961 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.633945 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 08:24:03.634628 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.634610 2580 fs.go:135] Filesystem UUIDs: map[596b4857-be90-4316-a9f9-2d08734450e9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 849a6344-70ed-40b1-995f-dc7c0206beb1:/dev/nvme0n1p4] Sep 17 08:24:03.634684 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.634628 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 08:24:03.640029 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.639923 2580 manager.go:216] Machine: {Timestamp:2026-09-17 08:24:03.638553555 +0000 UTC m=+0.360383492 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099932 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea5de41caf666693f05deb5e32e8d SystemUUID:ec2ea5de-41ca-f666-693f-05deb5e32e8d BootID:10709412-9601-4762-aa4a-22b9706ca6fd Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ce:59:7f:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ce:59:7f:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:2d:a7:a9:cc:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 08:24:03.640029 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.640029 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 08:24:03.640142 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.640126 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 08:24:03.643696 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.643674 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 08:24:03.643826 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.643699 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-148.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 08:24:03.644671 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.644662 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 08:24:03.644702 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.644674 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 08:24:03.644702 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.644682 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 08:24:03.645564 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.645554 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 08:24:03.646779 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.646770 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 08:24:03.651226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.651215 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 17 08:24:03.651355 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.651346 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 08:24:03.651391 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.651375 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 17 08:24:03.651391 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.651384 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 08:24:03.651448 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.651398 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 08:24:03.651448 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.651407 2580 kubelet.go:398] "Adding apiserver pod source" Sep 17 08:24:03.651448 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.651417 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 08:24:03.651766 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.651753 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 08:24:03.651810 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.651778 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 08:24:03.654219 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.654202 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 08:24:03.657292 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.657276 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 08:24:03.657388 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.657332 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 08:24:03.660130 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660116 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 08:24:03.660198 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660137 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 08:24:03.660198 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660147 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 08:24:03.660198 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660154 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 08:24:03.660198 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660167 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 08:24:03.660198 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660175 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 08:24:03.660415 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660226 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 08:24:03.660415 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660237 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 08:24:03.660415 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660255 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 08:24:03.660415 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660264 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 08:24:03.660415 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660277 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 08:24:03.660415 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.660287 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 08:24:03.661315 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.661291 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 08:24:03.661374 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.661319 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 08:24:03.667210 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.667195 2580 server.go:1268] "Started kubelet" Sep 17 08:24:03.667352 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.667275 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 08:24:03.667444 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.667286 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 08:24:03.667444 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.667390 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 08:24:03.668041 ip-10-0-140-148 systemd[1]: Started Kubernetes Kubelet. Sep 17 08:24:03.668876 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.668795 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 08:24:03.669433 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.669386 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 17 08:24:03.669526 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.669510 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-148.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 08:24:03.669856 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.669831 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 08:24:03.669856 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.669835 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 08:24:03.672914 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.672871 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 08:24:03.673288 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.672098 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-148.ec2.internal.18d60e2297f0a53c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-148.ec2.internal,UID:ip-10-0-140-148.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-148.ec2.internal,},FirstTimestamp:2026-09-17 08:24:03.667158332 +0000 UTC m=+0.388988270,LastTimestamp:2026-09-17 08:24:03.667158332 +0000 UTC m=+0.388988270,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-148.ec2.internal,}" Sep 17 08:24:03.676210 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.676188 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 08:24:03.676210 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.676199 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 08:24:03.676409 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.676392 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:03.676954 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.676938 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 08:24:03.677038 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.676937 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 08:24:03.677038 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.676974 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 08:24:03.677142 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.677031 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 17 08:24:03.677142 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.677067 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 17 08:24:03.677388 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.677368 2580 factory.go:55] Registering systemd factory Sep 17 08:24:03.677388 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.677390 2580 factory.go:223] Registration of the systemd container factory successfully Sep 17 08:24:03.677592 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.677580 2580 factory.go:153] Registering CRI-O factory Sep 17 08:24:03.677592 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.677594 2580 factory.go:223] Registration of the crio container factory successfully Sep 17 08:24:03.677665 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.677642 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 08:24:03.677665 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.677655 2580 factory.go:103] Registering Raw factory Sep 17 08:24:03.677736 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.677669 2580 manager.go:1196] Started watching for new ooms in manager Sep 17 08:24:03.678197 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.678177 2580 manager.go:349] Starting recovery of all containers Sep 17 08:24:03.683021 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.682931 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8dp6" Sep 17 08:24:03.689064 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.688937 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-148.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 08:24:03.689198 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.689127 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 08:24:03.690749 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.690725 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8dp6" Sep 17 08:24:03.690841 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.690799 2580 manager.go:354] Recovery completed Sep 17 08:24:03.694875 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.694862 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 08:24:03.696848 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.696753 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientMemory" Sep 17 08:24:03.696848 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.696792 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 08:24:03.696848 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.696804 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientPID" Sep 17 08:24:03.697384 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.697367 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 08:24:03.697384 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.697385 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 08:24:03.697501 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.697402 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 17 08:24:03.697501 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.697418 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 08:24:03.698063 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.698046 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientMemory" Sep 17 08:24:03.698114 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.698081 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 08:24:03.698114 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.698096 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientPID" Sep 17 08:24:03.699477 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.699464 2580 policy_none.go:49] "None policy: Start" Sep 17 08:24:03.699526 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.699481 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 08:24:03.699526 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.699491 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 08:24:03.701472 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.701460 2580 policy_none.go:47] "Start" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.740882 2580 manager.go:337] "Starting Device Plugin manager" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.740914 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.740924 2580 server.go:87] "Starting device plugin registration server" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.741148 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.741158 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.741260 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.741363 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.741373 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.741864 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 08:24:03.752736 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.741925 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:03.794735 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.794692 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 08:24:03.796074 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.796053 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 08:24:03.796161 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.796120 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 08:24:03.796161 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.796148 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 08:24:03.796244 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.796195 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 08:24:03.798944 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.798921 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 08:24:03.841989 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.841908 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 08:24:03.843402 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.843386 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientMemory" Sep 17 08:24:03.843460 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.843417 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 08:24:03.843460 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.843427 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientPID" Sep 17 08:24:03.843460 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.843455 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-148.ec2.internal" Sep 17 08:24:03.852712 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.852695 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-148.ec2.internal" Sep 17 08:24:03.852757 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.852717 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-148.ec2.internal\": node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:03.874266 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.874242 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:03.897268 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.897244 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal"] Sep 17 08:24:03.897380 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.897324 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 08:24:03.898667 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.898653 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientMemory" Sep 17 08:24:03.898754 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.898688 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 08:24:03.898754 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.898697 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientPID" Sep 17 08:24:03.901046 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.901033 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 08:24:03.901163 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.901148 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" Sep 17 08:24:03.901223 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.901199 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 08:24:03.901771 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.901755 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientMemory" Sep 17 08:24:03.901837 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.901788 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 08:24:03.901837 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.901799 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientMemory" Sep 17 08:24:03.901837 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.901822 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 08:24:03.901837 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.901835 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientPID" Sep 17 08:24:03.902013 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.901800 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientPID" Sep 17 08:24:03.904064 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.904047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal" Sep 17 08:24:03.904142 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.904076 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 08:24:03.904742 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.904727 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientMemory" Sep 17 08:24:03.904806 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.904755 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 08:24:03.904806 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.904765 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeHasSufficientPID" Sep 17 08:24:03.917848 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.917825 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-148.ec2.internal\" not found" node="ip-10-0-140-148.ec2.internal" Sep 17 08:24:03.922215 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.922198 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-148.ec2.internal\" not found" node="ip-10-0-140-148.ec2.internal" Sep 17 08:24:03.975227 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:03.975197 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:03.978489 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.978472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed28e8a4decff07b78d23c796a5cc5e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal\" (UID: \"ed28e8a4decff07b78d23c796a5cc5e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" Sep 17 08:24:03.978554 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.978499 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed28e8a4decff07b78d23c796a5cc5e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal\" (UID: \"ed28e8a4decff07b78d23c796a5cc5e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" Sep 17 08:24:03.978554 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:03.978514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/647917f02eb3787874c757d76b3690f4-config\") pod \"kube-apiserver-proxy-ip-10-0-140-148.ec2.internal\" (UID: \"647917f02eb3787874c757d76b3690f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal" Sep 17 08:24:04.075375 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:04.075336 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:04.078614 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.078599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/647917f02eb3787874c757d76b3690f4-config\") pod \"kube-apiserver-proxy-ip-10-0-140-148.ec2.internal\" (UID: \"647917f02eb3787874c757d76b3690f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal" Sep 17 08:24:04.078689 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.078622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed28e8a4decff07b78d23c796a5cc5e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal\" (UID: \"ed28e8a4decff07b78d23c796a5cc5e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" Sep 17 08:24:04.078689 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.078638 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed28e8a4decff07b78d23c796a5cc5e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal\" (UID: \"ed28e8a4decff07b78d23c796a5cc5e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" Sep 17 08:24:04.078689 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.078669 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed28e8a4decff07b78d23c796a5cc5e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal\" (UID: \"ed28e8a4decff07b78d23c796a5cc5e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" Sep 17 08:24:04.078781 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.078691 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/647917f02eb3787874c757d76b3690f4-config\") pod \"kube-apiserver-proxy-ip-10-0-140-148.ec2.internal\" (UID: \"647917f02eb3787874c757d76b3690f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal" Sep 17 08:24:04.078781 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.078724 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed28e8a4decff07b78d23c796a5cc5e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal\" (UID: \"ed28e8a4decff07b78d23c796a5cc5e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" Sep 17 08:24:04.176085 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:04.176014 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:04.220440 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.220415 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" Sep 17 08:24:04.225450 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.225329 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal" Sep 17 08:24:04.276950 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:04.276917 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:04.377400 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:04.377358 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:04.477905 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:04.477828 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:04.536688 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.536655 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 08:24:04.578031 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:04.578004 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:04.603403 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.603378 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 08:24:04.603542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.603520 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 08:24:04.603615 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.603562 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 08:24:04.678276 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:04.678244 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:04.696877 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.696844 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 08:19:04 +0000 UTC" deadline="2028-06-06 07:26:23.468252864 +0000 UTC" Sep 17 08:24:04.696877 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.696870 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15071h2m18.771386222s" Sep 17 08:24:04.778354 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:04.778326 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:04.831484 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.831458 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 08:24:04.877859 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:04.877831 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647917f02eb3787874c757d76b3690f4.slice/crio-58333a446d4e212261c5ba18cd0ee0fa16cf3c91253f277d9b585a6c144f8916 WatchSource:0}: Error finding container 58333a446d4e212261c5ba18cd0ee0fa16cf3c91253f277d9b585a6c144f8916: Status 404 returned error can't find the container with id 58333a446d4e212261c5ba18cd0ee0fa16cf3c91253f277d9b585a6c144f8916 Sep 17 08:24:04.878918 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:04.878899 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:04.887883 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:04.887868 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 08:24:04.899208 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:04.899185 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded28e8a4decff07b78d23c796a5cc5e4.slice/crio-c24d108ea53cb255c2777343dc83de5bf38313f997e011b8e71433cc7e099992 WatchSource:0}: Error finding container c24d108ea53cb255c2777343dc83de5bf38313f997e011b8e71433cc7e099992: Status 404 returned error can't find the container with id c24d108ea53cb255c2777343dc83de5bf38313f997e011b8e71433cc7e099992 Sep 17 08:24:06.234025 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:06.233993 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:06.334537 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:06.334466 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:06.435327 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:06.435300 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-148.ec2.internal\" not found" Sep 17 08:24:06.487408 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.487385 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 08:24:06.530859 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.530832 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" Sep 17 08:24:06.543925 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.543903 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 08:24:06.544652 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.544640 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal" Sep 17 08:24:06.552254 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.552241 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 08:24:06.906285 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.906256 2580 apiserver.go:52] "Watching apiserver" Sep 17 08:24:06.914494 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.914476 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 08:24:06.914892 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.914872 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bn7qh","kube-system/konnectivity-agent-gphn5","kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98","openshift-cluster-node-tuning-operator/tuned-92xqx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal","openshift-multus/multus-gzg8r","openshift-multus/network-metrics-daemon-xjrm2","openshift-dns/node-resolver-6dks4","openshift-image-registry/node-ca-9r77w","openshift-multus/multus-additional-cni-plugins-c6bjp","openshift-network-diagnostics/network-check-target-q4gsh","openshift-network-operator/iptables-alerter-sx2lz","openshift-ovn-kubernetes/ovnkube-node-tbwwd"] Sep 17 08:24:06.917582 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.917567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.919549 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.919526 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:06.919932 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.919913 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 08:24:06.920054 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.920032 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 08:24:06.920138 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.920125 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tvcvc\"" Sep 17 08:24:06.920175 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.920156 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 08:24:06.920220 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.920126 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 08:24:06.922287 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.921829 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 08:24:06.922287 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.921855 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 08:24:06.922287 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.921904 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.922287 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.921860 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 08:24:06.922287 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.922146 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r654r\"" Sep 17 08:24:06.923974 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.923933 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 08:24:06.924307 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.924279 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 08:24:06.924388 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.924375 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 08:24:06.924445 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.924385 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:06.924445 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.924402 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 08:24:06.924756 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.924739 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mvzp9\"" Sep 17 08:24:06.924828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.924785 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 08:24:06.925325 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.925313 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 08:24:06.926584 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.926567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.926724 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.926707 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 08:24:06.926830 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.926806 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q4vsc\"" Sep 17 08:24:06.926962 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.926928 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 08:24:06.927047 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.927029 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 08:24:06.929106 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.929083 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 08:24:06.929195 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.929122 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k8kf7\"" Sep 17 08:24:06.929349 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.929333 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:06.929399 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.929354 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 08:24:06.929443 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:06.929412 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:06.929542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.929527 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 08:24:06.931075 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.930806 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 08:24:06.931379 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.931362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:06.933608 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.933589 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:06.933727 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:06.933668 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:06.933826 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.933809 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 08:24:06.933886 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.933809 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 08:24:06.933886 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.933857 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-snrr2\"" Sep 17 08:24:06.935870 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.935844 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:06.938158 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.938138 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 08:24:06.938251 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.938159 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 08:24:06.938251 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.938223 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:06.938528 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.938514 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4tsxq\"" Sep 17 08:24:06.939061 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vzmm\" (UniqueName: \"kubernetes.io/projected/6e720820-bb49-4fc7-97a5-b7171e9b7e14-kube-api-access-7vzmm\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:06.939125 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-cni-binary-copy\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.939125 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-var-lib-cni-bin\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.939125 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-run-ovn-kubernetes\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.939277 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:06.939277 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-var-lib-cni-multus\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.939277 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-registration-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:06.939277 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939193 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-kubernetes\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.939277 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939222 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-sysctl-conf\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.939277 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939258 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-systemd-units\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqlrs\" (UniqueName: \"kubernetes.io/projected/edc69206-7d0f-4086-964c-77facc99d777-kube-api-access-mqlrs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-system-cni-dir\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939332 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-cni-dir\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-cni-netd\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxzw4\" (UniqueName: \"kubernetes.io/projected/b64902d3-2e97-4fa9-b338-e20f0b864036-kube-api-access-fxzw4\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-run-k8s-cni-cncf-io\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q94k5\" (UniqueName: \"kubernetes.io/projected/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-kube-api-access-q94k5\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939447 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-modprobe-d\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-sys\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-sys-fs\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smsp7\" (UniqueName: \"kubernetes.io/projected/6f15278e-dac9-4be3-9d3b-e09d5b36fb6a-kube-api-access-smsp7\") pod \"iptables-alerter-sx2lz\" (UID: \"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a\") " pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-host\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.939565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-var-lib-kubelet\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-daemon-config\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-run\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-var-lib-kubelet\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/179a10c1-4d7a-4055-aace-6dec464d4097-tmp-dir\") pod \"node-resolver-6dks4\" (UID: \"179a10c1-4d7a-4055-aace-6dec464d4097\") " pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939726 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-log-socket\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939753 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-cni-bin\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939779 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-run-netns\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-var-lib-openvswitch\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939888 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-node-log\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b64902d3-2e97-4fa9-b338-e20f0b864036-env-overrides\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-systemd\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939943 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-run-systemd\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940079 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.939980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-run-ovn\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b64902d3-2e97-4fa9-b338-e20f0b864036-ovnkube-script-lib\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-dbus\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-run-netns\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-device-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-hostroot\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9zjv\" (UniqueName: \"kubernetes.io/projected/179a10c1-4d7a-4055-aace-6dec464d4097-kube-api-access-x9zjv\") pod \"node-resolver-6dks4\" (UID: \"179a10c1-4d7a-4055-aace-6dec464d4097\") " pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940124 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-kubelet\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940137 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-run-openvswitch\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-cnibin\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940186 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-conf-dir\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-lib-modules\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-kubelet-config\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940228 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-etc-openvswitch\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940277 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f15278e-dac9-4be3-9d3b-e09d5b36fb6a-iptables-alerter-script\") pod \"iptables-alerter-sx2lz\" (UID: \"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a\") " pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940327 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f15278e-dac9-4be3-9d3b-e09d5b36fb6a-host-slash\") pod \"iptables-alerter-sx2lz\" (UID: \"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a\") " pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:06.940660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9cxq\" (UniqueName: \"kubernetes.io/projected/5e248508-31ae-4055-9d00-3359ff5d67dc-kube-api-access-m9cxq\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/179a10c1-4d7a-4055-aace-6dec464d4097-hosts-file\") pod \"node-resolver-6dks4\" (UID: \"179a10c1-4d7a-4055-aace-6dec464d4097\") " pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b64902d3-2e97-4fa9-b338-e20f0b864036-ovn-node-metrics-cert\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-sysconfig\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940428 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e248508-31ae-4055-9d00-3359ff5d67dc-tmp\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940453 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-slash\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940469 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tp5g4\"" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-socket-dir-parent\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-run-multus-certs\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-etc-kubernetes\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940559 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-tuned\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-sysctl-d\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940615 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b64902d3-2e97-4fa9-b338-e20f0b864036-ovnkube-config\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-socket-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940826 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:06.941310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.940957 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 08:24:06.942892 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.942877 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:06.942951 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:06.942919 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:06.943957 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.943941 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 08:24:06.944041 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.943969 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kdqvg\"" Sep 17 08:24:06.944142 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.944125 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 08:24:06.946355 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.946337 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 08:24:06.964705 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.964682 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-krwmf" Sep 17 08:24:06.973124 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:06.973104 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-krwmf" Sep 17 08:24:07.032458 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.032428 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 08:24:07.041274 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-sysconfig\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.041403 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e248508-31ae-4055-9d00-3359ff5d67dc-tmp\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.041403 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-slash\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.041403 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-socket-dir-parent\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.041403 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041371 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-sysconfig\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041400 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-slash\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041413 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-run-multus-certs\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-etc-kubernetes\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-tuned\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041479 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-socket-dir-parent\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041495 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-run-multus-certs\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041528 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-etc-kubernetes\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dab4b815-e4b7-4b19-a4c9-9ae24bd453a8-agent-certs\") pod \"konnectivity-agent-gphn5\" (UID: \"dab4b815-e4b7-4b19-a4c9-9ae24bd453a8\") " pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:07.041604 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-sysctl-d\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b64902d3-2e97-4fa9-b338-e20f0b864036-ovnkube-config\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-socket-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vzmm\" (UniqueName: \"kubernetes.io/projected/6e720820-bb49-4fc7-97a5-b7171e9b7e14-kube-api-access-7vzmm\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041727 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-sysctl-d\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-cni-binary-copy\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041746 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-socket-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-var-lib-cni-bin\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-run-ovn-kubernetes\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-var-lib-cni-multus\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/544118fc-af72-4f25-aeb3-6f43c91e993e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-registration-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-kubernetes\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-sysctl-conf\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041964 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041979 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/544118fc-af72-4f25-aeb3-6f43c91e993e-cnibin\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.042099 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042017 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-registration-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041881 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-run-ovn-kubernetes\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-systemd-units\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqlrs\" (UniqueName: \"kubernetes.io/projected/edc69206-7d0f-4086-964c-77facc99d777-kube-api-access-mqlrs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042065 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-systemd-units\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-system-cni-dir\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.041977 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-var-lib-cni-multus\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-cni-dir\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042148 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-sysctl-conf\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-kubernetes\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042243 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-cni-dir\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042258 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-system-cni-dir\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76fa79c8-f383-45bb-8f79-31a592ed0239-serviceca\") pod \"node-ca-9r77w\" (UID: \"76fa79c8-f383-45bb-8f79-31a592ed0239\") " pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042306 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-cni-netd\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxzw4\" (UniqueName: \"kubernetes.io/projected/b64902d3-2e97-4fa9-b338-e20f0b864036-kube-api-access-fxzw4\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-run-k8s-cni-cncf-io\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-cni-netd\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.042849 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q94k5\" (UniqueName: \"kubernetes.io/projected/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-kube-api-access-q94k5\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-modprobe-d\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042478 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-run-k8s-cni-cncf-io\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-sys\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042548 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-sys\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042649 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-var-lib-cni-bin\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042681 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-modprobe-d\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dab4b815-e4b7-4b19-a4c9-9ae24bd453a8-konnectivity-ca\") pod \"konnectivity-agent-gphn5\" (UID: \"dab4b815-e4b7-4b19-a4c9-9ae24bd453a8\") " pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b64902d3-2e97-4fa9-b338-e20f0b864036-ovnkube-config\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/544118fc-af72-4f25-aeb3-6f43c91e993e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-sys-fs\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smsp7\" (UniqueName: \"kubernetes.io/projected/6f15278e-dac9-4be3-9d3b-e09d5b36fb6a-kube-api-access-smsp7\") pod \"iptables-alerter-sx2lz\" (UID: \"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a\") " pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042890 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.042898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-host\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76fa79c8-f383-45bb-8f79-31a592ed0239-host\") pod \"node-ca-9r77w\" (UID: \"76fa79c8-f383-45bb-8f79-31a592ed0239\") " pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/544118fc-af72-4f25-aeb3-6f43c91e993e-cni-binary-copy\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.043542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/544118fc-af72-4f25-aeb3-6f43c91e993e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-var-lib-kubelet\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-daemon-config\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043563 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-run\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043508 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-sys-fs\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-var-lib-kubelet\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/179a10c1-4d7a-4055-aace-6dec464d4097-tmp-dir\") pod \"node-resolver-6dks4\" (UID: \"179a10c1-4d7a-4055-aace-6dec464d4097\") " pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-log-socket\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043696 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-cni-binary-copy\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-cni-bin\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043764 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-cni-bin\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.043877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-var-lib-kubelet\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044187 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044266 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-var-lib-kubelet\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.044310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044306 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-host\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044330 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-run\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044362 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-log-socket\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044515 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/179a10c1-4d7a-4055-aace-6dec464d4097-tmp-dir\") pod \"node-resolver-6dks4\" (UID: \"179a10c1-4d7a-4055-aace-6dec464d4097\") " pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-run-netns\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044541 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-daemon-config\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-host-run-netns\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.044666 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.044783 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs podName:edc69206-7d0f-4086-964c-77facc99d777 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:07.544750694 +0000 UTC m=+3.012262973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs") pod "network-metrics-daemon-xjrm2" (UID: "edc69206-7d0f-4086-964c-77facc99d777") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l62n\" (UniqueName: \"kubernetes.io/projected/544118fc-af72-4f25-aeb3-6f43c91e993e-kube-api-access-7l62n\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044864 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-var-lib-openvswitch\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044903 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-node-log\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044938 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b64902d3-2e97-4fa9-b338-e20f0b864036-env-overrides\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.044969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-systemd\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.045001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-node-log\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-run-systemd\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-run-ovn\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045110 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-var-lib-openvswitch\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b64902d3-2e97-4fa9-b338-e20f0b864036-ovnkube-script-lib\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-dbus\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045178 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd5cz\" (UniqueName: \"kubernetes.io/projected/76fa79c8-f383-45bb-8f79-31a592ed0239-kube-api-access-vd5cz\") pod \"node-ca-9r77w\" (UID: \"76fa79c8-f383-45bb-8f79-31a592ed0239\") " pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.045198 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045210 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/544118fc-af72-4f25-aeb3-6f43c91e993e-system-cni-dir\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-run-netns\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.045254 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret podName:a141cbb6-0bb2-4cc8-b905-5f2cd1f28824 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:07.545237235 +0000 UTC m=+3.012749498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret") pod "global-pull-secret-syncer-bn7qh" (UID: "a141cbb6-0bb2-4cc8-b905-5f2cd1f28824") : object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-device-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045296 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-run-netns\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045324 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-hostroot\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045346 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-run-systemd\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9zjv\" (UniqueName: \"kubernetes.io/projected/179a10c1-4d7a-4055-aace-6dec464d4097-kube-api-access-x9zjv\") pod \"node-resolver-6dks4\" (UID: \"179a10c1-4d7a-4055-aace-6dec464d4097\") " pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:07.045737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045394 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-run-ovn\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-kubelet\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-run-openvswitch\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-cnibin\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-conf-dir\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-lib-modules\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-kubelet-config\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-etc-openvswitch\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f15278e-dac9-4be3-9d3b-e09d5b36fb6a-iptables-alerter-script\") pod \"iptables-alerter-sx2lz\" (UID: \"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a\") " pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f15278e-dac9-4be3-9d3b-e09d5b36fb6a-host-slash\") pod \"iptables-alerter-sx2lz\" (UID: \"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a\") " pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9cxq\" (UniqueName: \"kubernetes.io/projected/5e248508-31ae-4055-9d00-3359ff5d67dc-kube-api-access-m9cxq\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/179a10c1-4d7a-4055-aace-6dec464d4097-hosts-file\") pod \"node-resolver-6dks4\" (UID: \"179a10c1-4d7a-4055-aace-6dec464d4097\") " pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.045854 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b64902d3-2e97-4fa9-b338-e20f0b864036-ovn-node-metrics-cert\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b64902d3-2e97-4fa9-b338-e20f0b864036-env-overrides\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046078 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-systemd\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046152 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e720820-bb49-4fc7-97a5-b7171e9b7e14-device-dir\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046203 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-hostroot\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.046521 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-multus-conf-dir\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046661 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-dbus\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046734 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-run-openvswitch\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-host-kubelet\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046842 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-cnibin\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.046867 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e248508-31ae-4055-9d00-3359ff5d67dc-tmp\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.047014 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/179a10c1-4d7a-4055-aace-6dec464d4097-hosts-file\") pod \"node-resolver-6dks4\" (UID: \"179a10c1-4d7a-4055-aace-6dec464d4097\") " pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.047067 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-kubelet-config\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.047077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e248508-31ae-4055-9d00-3359ff5d67dc-lib-modules\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.047106 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f15278e-dac9-4be3-9d3b-e09d5b36fb6a-host-slash\") pod \"iptables-alerter-sx2lz\" (UID: \"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a\") " pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.047139 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b64902d3-2e97-4fa9-b338-e20f0b864036-etc-openvswitch\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.047299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.047234 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b64902d3-2e97-4fa9-b338-e20f0b864036-ovnkube-script-lib\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.047781 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.047593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f15278e-dac9-4be3-9d3b-e09d5b36fb6a-iptables-alerter-script\") pod \"iptables-alerter-sx2lz\" (UID: \"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a\") " pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:07.049103 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.049078 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b64902d3-2e97-4fa9-b338-e20f0b864036-ovn-node-metrics-cert\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.049654 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.049611 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e248508-31ae-4055-9d00-3359ff5d67dc-etc-tuned\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.054993 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.054968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smsp7\" (UniqueName: \"kubernetes.io/projected/6f15278e-dac9-4be3-9d3b-e09d5b36fb6a-kube-api-access-smsp7\") pod \"iptables-alerter-sx2lz\" (UID: \"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a\") " pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:07.055341 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.055314 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q94k5\" (UniqueName: \"kubernetes.io/projected/2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1-kube-api-access-q94k5\") pod \"multus-gzg8r\" (UID: \"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1\") " pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.055480 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.055460 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqlrs\" (UniqueName: \"kubernetes.io/projected/edc69206-7d0f-4086-964c-77facc99d777-kube-api-access-mqlrs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:07.056050 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.056025 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxzw4\" (UniqueName: \"kubernetes.io/projected/b64902d3-2e97-4fa9-b338-e20f0b864036-kube-api-access-fxzw4\") pod \"ovnkube-node-tbwwd\" (UID: \"b64902d3-2e97-4fa9-b338-e20f0b864036\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.056161 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.056126 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vzmm\" (UniqueName: \"kubernetes.io/projected/6e720820-bb49-4fc7-97a5-b7171e9b7e14-kube-api-access-7vzmm\") pod \"aws-ebs-csi-driver-node-wvb98\" (UID: \"6e720820-bb49-4fc7-97a5-b7171e9b7e14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.056325 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.056281 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" event={"ID":"ed28e8a4decff07b78d23c796a5cc5e4","Type":"ContainerStarted","Data":"c24d108ea53cb255c2777343dc83de5bf38313f997e011b8e71433cc7e099992"} Sep 17 08:24:07.056669 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.056645 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9zjv\" (UniqueName: \"kubernetes.io/projected/179a10c1-4d7a-4055-aace-6dec464d4097-kube-api-access-x9zjv\") pod \"node-resolver-6dks4\" (UID: \"179a10c1-4d7a-4055-aace-6dec464d4097\") " pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:07.057515 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.057497 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal" event={"ID":"647917f02eb3787874c757d76b3690f4","Type":"ContainerStarted","Data":"58333a446d4e212261c5ba18cd0ee0fa16cf3c91253f277d9b585a6c144f8916"} Sep 17 08:24:07.057611 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.057597 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9cxq\" (UniqueName: \"kubernetes.io/projected/5e248508-31ae-4055-9d00-3359ff5d67dc-kube-api-access-m9cxq\") pod \"tuned-92xqx\" (UID: \"5e248508-31ae-4055-9d00-3359ff5d67dc\") " pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.146450 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/544118fc-af72-4f25-aeb3-6f43c91e993e-cnibin\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.146661 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146461 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76fa79c8-f383-45bb-8f79-31a592ed0239-serviceca\") pod \"node-ca-9r77w\" (UID: \"76fa79c8-f383-45bb-8f79-31a592ed0239\") " pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.146661 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146490 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dab4b815-e4b7-4b19-a4c9-9ae24bd453a8-konnectivity-ca\") pod \"konnectivity-agent-gphn5\" (UID: \"dab4b815-e4b7-4b19-a4c9-9ae24bd453a8\") " pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:07.146661 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146514 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/544118fc-af72-4f25-aeb3-6f43c91e993e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.146661 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76fa79c8-f383-45bb-8f79-31a592ed0239-host\") pod \"node-ca-9r77w\" (UID: \"76fa79c8-f383-45bb-8f79-31a592ed0239\") " pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.146661 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/544118fc-af72-4f25-aeb3-6f43c91e993e-cni-binary-copy\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.146661 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/544118fc-af72-4f25-aeb3-6f43c91e993e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.146661 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l62n\" (UniqueName: \"kubernetes.io/projected/544118fc-af72-4f25-aeb3-6f43c91e993e-kube-api-access-7l62n\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.146661 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd5cz\" (UniqueName: \"kubernetes.io/projected/76fa79c8-f383-45bb-8f79-31a592ed0239-kube-api-access-vd5cz\") pod \"node-ca-9r77w\" (UID: \"76fa79c8-f383-45bb-8f79-31a592ed0239\") " pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.146945 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146900 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76fa79c8-f383-45bb-8f79-31a592ed0239-host\") pod \"node-ca-9r77w\" (UID: \"76fa79c8-f383-45bb-8f79-31a592ed0239\") " pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.146945 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.146915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/544118fc-af72-4f25-aeb3-6f43c91e993e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.147095 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.147077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/544118fc-af72-4f25-aeb3-6f43c91e993e-cnibin\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.147358 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.147337 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/544118fc-af72-4f25-aeb3-6f43c91e993e-cni-binary-copy\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.147524 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.147505 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76fa79c8-f383-45bb-8f79-31a592ed0239-serviceca\") pod \"node-ca-9r77w\" (UID: \"76fa79c8-f383-45bb-8f79-31a592ed0239\") " pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.147585 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.147553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/544118fc-af72-4f25-aeb3-6f43c91e993e-system-cni-dir\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.147666 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.147603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:07.147666 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.147647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dab4b815-e4b7-4b19-a4c9-9ae24bd453a8-agent-certs\") pod \"konnectivity-agent-gphn5\" (UID: \"dab4b815-e4b7-4b19-a4c9-9ae24bd453a8\") " pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:07.147774 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.147682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/544118fc-af72-4f25-aeb3-6f43c91e993e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.147853 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.147832 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/544118fc-af72-4f25-aeb3-6f43c91e993e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.148019 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.147997 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dab4b815-e4b7-4b19-a4c9-9ae24bd453a8-konnectivity-ca\") pod \"konnectivity-agent-gphn5\" (UID: \"dab4b815-e4b7-4b19-a4c9-9ae24bd453a8\") " pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:07.148207 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.148189 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/544118fc-af72-4f25-aeb3-6f43c91e993e-system-cni-dir\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.148274 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.148204 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/544118fc-af72-4f25-aeb3-6f43c91e993e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.151081 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.151058 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dab4b815-e4b7-4b19-a4c9-9ae24bd453a8-agent-certs\") pod \"konnectivity-agent-gphn5\" (UID: \"dab4b815-e4b7-4b19-a4c9-9ae24bd453a8\") " pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:07.153391 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.153367 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 08:24:07.153493 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.153396 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 08:24:07.153493 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.153409 2580 projected.go:196] Error preparing data for projected volume kube-api-access-b8gfw for pod openshift-network-diagnostics/network-check-target-q4gsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:07.153493 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.153477 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw podName:fd354192-24d2-4e8f-a7f7-f9c0c7c0d839 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:07.653459035 +0000 UTC m=+3.120971298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b8gfw" (UniqueName: "kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw") pod "network-check-target-q4gsh" (UID: "fd354192-24d2-4e8f-a7f7-f9c0c7c0d839") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:07.155458 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.155432 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd5cz\" (UniqueName: \"kubernetes.io/projected/76fa79c8-f383-45bb-8f79-31a592ed0239-kube-api-access-vd5cz\") pod \"node-ca-9r77w\" (UID: \"76fa79c8-f383-45bb-8f79-31a592ed0239\") " pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.155537 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.155432 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l62n\" (UniqueName: \"kubernetes.io/projected/544118fc-af72-4f25-aeb3-6f43c91e993e-kube-api-access-7l62n\") pod \"multus-additional-cni-plugins-c6bjp\" (UID: \"544118fc-af72-4f25-aeb3-6f43c91e993e\") " pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.228153 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.228072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gzg8r" Sep 17 08:24:07.236585 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.236557 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sx2lz" Sep 17 08:24:07.239106 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:07.239075 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5d3c9f_7170_4012_8f1c_e2f0e05e9ab1.slice/crio-6fc863417b185b9a66b3504b3a4f6050ef99cef2a2e0cb2d55859c0e97044385 WatchSource:0}: Error finding container 6fc863417b185b9a66b3504b3a4f6050ef99cef2a2e0cb2d55859c0e97044385: Status 404 returned error can't find the container with id 6fc863417b185b9a66b3504b3a4f6050ef99cef2a2e0cb2d55859c0e97044385 Sep 17 08:24:07.243196 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.243172 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:07.245309 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:07.245287 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f15278e_dac9_4be3_9d3b_e09d5b36fb6a.slice/crio-82e225389087f361cab9b34d4b2d852849175b74419d300fbe5632a68b49f010 WatchSource:0}: Error finding container 82e225389087f361cab9b34d4b2d852849175b74419d300fbe5632a68b49f010: Status 404 returned error can't find the container with id 82e225389087f361cab9b34d4b2d852849175b74419d300fbe5632a68b49f010 Sep 17 08:24:07.248874 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.248854 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" Sep 17 08:24:07.254185 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.254155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-92xqx" Sep 17 08:24:07.254487 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:07.254463 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64902d3_2e97_4fa9_b338_e20f0b864036.slice/crio-f5c303034131f7898f2b2f65707393ec41305473637c3ccb5b372235ea4806c0 WatchSource:0}: Error finding container f5c303034131f7898f2b2f65707393ec41305473637c3ccb5b372235ea4806c0: Status 404 returned error can't find the container with id f5c303034131f7898f2b2f65707393ec41305473637c3ccb5b372235ea4806c0 Sep 17 08:24:07.259370 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.259351 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6dks4" Sep 17 08:24:07.259476 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:07.259446 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e720820_bb49_4fc7_97a5_b7171e9b7e14.slice/crio-70aee4aa2ab33c2bdfb3107165b0bc33775030a4be56ef4f398750fdb63fe13e WatchSource:0}: Error finding container 70aee4aa2ab33c2bdfb3107165b0bc33775030a4be56ef4f398750fdb63fe13e: Status 404 returned error can't find the container with id 70aee4aa2ab33c2bdfb3107165b0bc33775030a4be56ef4f398750fdb63fe13e Sep 17 08:24:07.263975 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.263955 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:07.264893 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:07.264874 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e248508_31ae_4055_9d00_3359ff5d67dc.slice/crio-21cc8063369b417040b7a87feedfa67cd4824419571fa061a2192fa8ba8b4cf5 WatchSource:0}: Error finding container 21cc8063369b417040b7a87feedfa67cd4824419571fa061a2192fa8ba8b4cf5: Status 404 returned error can't find the container with id 21cc8063369b417040b7a87feedfa67cd4824419571fa061a2192fa8ba8b4cf5 Sep 17 08:24:07.270093 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.270072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9r77w" Sep 17 08:24:07.273769 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.273753 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" Sep 17 08:24:07.273905 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:07.273876 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179a10c1_4d7a_4055_aace_6dec464d4097.slice/crio-7e13f53284cd560985754a35aab9c9f0f0f8f69b5ea91247a9124be92e318d03 WatchSource:0}: Error finding container 7e13f53284cd560985754a35aab9c9f0f0f8f69b5ea91247a9124be92e318d03: Status 404 returned error can't find the container with id 7e13f53284cd560985754a35aab9c9f0f0f8f69b5ea91247a9124be92e318d03 Sep 17 08:24:07.278025 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:07.278001 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab4b815_e4b7_4b19_a4c9_9ae24bd453a8.slice/crio-28f871f061aa473000a532c096d6ca5f95fd1d09b75e3bcc73aafce1820e9a1f WatchSource:0}: Error finding container 28f871f061aa473000a532c096d6ca5f95fd1d09b75e3bcc73aafce1820e9a1f: Status 404 returned error can't find the container with id 28f871f061aa473000a532c096d6ca5f95fd1d09b75e3bcc73aafce1820e9a1f Sep 17 08:24:07.282610 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:07.282589 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fa79c8_f383_45bb_8f79_31a592ed0239.slice/crio-0b9021e53c420bf6b4dc448e62d36926bb380f964d465e014568c0617008d07b WatchSource:0}: Error finding container 0b9021e53c420bf6b4dc448e62d36926bb380f964d465e014568c0617008d07b: Status 404 returned error can't find the container with id 0b9021e53c420bf6b4dc448e62d36926bb380f964d465e014568c0617008d07b Sep 17 08:24:07.287536 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:07.287511 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544118fc_af72_4f25_aeb3_6f43c91e993e.slice/crio-d2cfe52fa638353efa52990b7a7ae666c9993297c4ddc05978cebba2be293902 WatchSource:0}: Error finding container d2cfe52fa638353efa52990b7a7ae666c9993297c4ddc05978cebba2be293902: Status 404 returned error can't find the container with id d2cfe52fa638353efa52990b7a7ae666c9993297c4ddc05978cebba2be293902 Sep 17 08:24:07.551312 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.551229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:07.551312 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.551286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:07.551530 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.551406 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:07.551530 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.551421 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:07.551530 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.551488 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret podName:a141cbb6-0bb2-4cc8-b905-5f2cd1f28824 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:08.551470226 +0000 UTC m=+4.018982500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret") pod "global-pull-secret-syncer-bn7qh" (UID: "a141cbb6-0bb2-4cc8-b905-5f2cd1f28824") : object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:07.551530 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.551509 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs podName:edc69206-7d0f-4086-964c-77facc99d777 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:08.551499544 +0000 UTC m=+4.019011817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs") pod "network-metrics-daemon-xjrm2" (UID: "edc69206-7d0f-4086-964c-77facc99d777") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:07.752267 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.752231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:07.752884 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.752435 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 08:24:07.752884 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.752468 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 08:24:07.752884 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.752484 2580 projected.go:196] Error preparing data for projected volume kube-api-access-b8gfw for pod openshift-network-diagnostics/network-check-target-q4gsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:07.752884 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:07.752553 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw podName:fd354192-24d2-4e8f-a7f7-f9c0c7c0d839 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:08.752534336 +0000 UTC m=+4.220046602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8gfw" (UniqueName: "kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw") pod "network-check-target-q4gsh" (UID: "fd354192-24d2-4e8f-a7f7-f9c0c7c0d839") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:07.976157 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.976076 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 08:19:06 +0000 UTC" deadline="2028-03-11 00:27:19.666262919 +0000 UTC" Sep 17 08:24:07.976157 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:07.976107 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12976h3m11.690159353s" Sep 17 08:24:08.060780 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.060738 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9r77w" event={"ID":"76fa79c8-f383-45bb-8f79-31a592ed0239","Type":"ContainerStarted","Data":"0b9021e53c420bf6b4dc448e62d36926bb380f964d465e014568c0617008d07b"} Sep 17 08:24:08.062343 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.062223 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gphn5" event={"ID":"dab4b815-e4b7-4b19-a4c9-9ae24bd453a8","Type":"ContainerStarted","Data":"28f871f061aa473000a532c096d6ca5f95fd1d09b75e3bcc73aafce1820e9a1f"} Sep 17 08:24:08.064301 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.064238 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6dks4" event={"ID":"179a10c1-4d7a-4055-aace-6dec464d4097","Type":"ContainerStarted","Data":"7e13f53284cd560985754a35aab9c9f0f0f8f69b5ea91247a9124be92e318d03"} Sep 17 08:24:08.065836 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.065806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" event={"ID":"6e720820-bb49-4fc7-97a5-b7171e9b7e14","Type":"ContainerStarted","Data":"70aee4aa2ab33c2bdfb3107165b0bc33775030a4be56ef4f398750fdb63fe13e"} Sep 17 08:24:08.067364 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.067310 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sx2lz" event={"ID":"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a","Type":"ContainerStarted","Data":"82e225389087f361cab9b34d4b2d852849175b74419d300fbe5632a68b49f010"} Sep 17 08:24:08.068671 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.068649 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gzg8r" event={"ID":"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1","Type":"ContainerStarted","Data":"6fc863417b185b9a66b3504b3a4f6050ef99cef2a2e0cb2d55859c0e97044385"} Sep 17 08:24:08.070465 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.070439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" event={"ID":"544118fc-af72-4f25-aeb3-6f43c91e993e","Type":"ContainerStarted","Data":"d2cfe52fa638353efa52990b7a7ae666c9993297c4ddc05978cebba2be293902"} Sep 17 08:24:08.071965 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.071942 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-92xqx" event={"ID":"5e248508-31ae-4055-9d00-3359ff5d67dc","Type":"ContainerStarted","Data":"21cc8063369b417040b7a87feedfa67cd4824419571fa061a2192fa8ba8b4cf5"} Sep 17 08:24:08.073304 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.073277 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" event={"ID":"b64902d3-2e97-4fa9-b338-e20f0b864036","Type":"ContainerStarted","Data":"f5c303034131f7898f2b2f65707393ec41305473637c3ccb5b372235ea4806c0"} Sep 17 08:24:08.560334 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.560087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:08.560334 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.560143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:08.560334 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:08.560270 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:08.560334 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:08.560331 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret podName:a141cbb6-0bb2-4cc8-b905-5f2cd1f28824 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:10.560313382 +0000 UTC m=+6.027825659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret") pod "global-pull-secret-syncer-bn7qh" (UID: "a141cbb6-0bb2-4cc8-b905-5f2cd1f28824") : object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:08.561036 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:08.560760 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:08.561036 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:08.560815 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs podName:edc69206-7d0f-4086-964c-77facc99d777 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:10.560799342 +0000 UTC m=+6.028311619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs") pod "network-metrics-daemon-xjrm2" (UID: "edc69206-7d0f-4086-964c-77facc99d777") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:08.667207 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.667173 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 08:24:08.761529 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.761308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:08.761761 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:08.761533 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 08:24:08.761761 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:08.761555 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 08:24:08.761761 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:08.761589 2580 projected.go:196] Error preparing data for projected volume kube-api-access-b8gfw for pod openshift-network-diagnostics/network-check-target-q4gsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:08.761761 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:08.761664 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw podName:fd354192-24d2-4e8f-a7f7-f9c0c7c0d839 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:10.761645148 +0000 UTC m=+6.229157424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8gfw" (UniqueName: "kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw") pod "network-check-target-q4gsh" (UID: "fd354192-24d2-4e8f-a7f7-f9c0c7c0d839") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:08.977091 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.977025 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 08:19:06 +0000 UTC" deadline="2028-03-10 18:53:35.744914149 +0000 UTC" Sep 17 08:24:08.977091 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:08.977088 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12970h29m26.76782981s" Sep 17 08:24:09.052284 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:09.051740 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:09.052284 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:09.051773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:09.052284 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:09.051884 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:09.052284 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:09.051984 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:09.052284 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:09.052094 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:09.052284 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:09.052183 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:10.087425 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:10.086719 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal" event={"ID":"647917f02eb3787874c757d76b3690f4","Type":"ContainerStarted","Data":"4e2d0d8ff1bce482a0d3abe414f48575cdeb42ae945aeecf0dde4256cc5fa305"} Sep 17 08:24:10.579147 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:10.579114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:10.579318 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:10.579161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:10.579318 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:10.579277 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:10.579417 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:10.579336 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret podName:a141cbb6-0bb2-4cc8-b905-5f2cd1f28824 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:14.579319167 +0000 UTC m=+10.046831441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret") pod "global-pull-secret-syncer-bn7qh" (UID: "a141cbb6-0bb2-4cc8-b905-5f2cd1f28824") : object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:10.579769 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:10.579747 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:10.579884 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:10.579804 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs podName:edc69206-7d0f-4086-964c-77facc99d777 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:14.579788592 +0000 UTC m=+10.047300864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs") pod "network-metrics-daemon-xjrm2" (UID: "edc69206-7d0f-4086-964c-77facc99d777") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:10.781331 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:10.781236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:10.781497 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:10.781430 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 08:24:10.781497 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:10.781456 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 08:24:10.781497 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:10.781468 2580 projected.go:196] Error preparing data for projected volume kube-api-access-b8gfw for pod openshift-network-diagnostics/network-check-target-q4gsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:10.781735 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:10.781518 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw podName:fd354192-24d2-4e8f-a7f7-f9c0c7c0d839 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:14.781501707 +0000 UTC m=+10.249013970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8gfw" (UniqueName: "kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw") pod "network-check-target-q4gsh" (UID: "fd354192-24d2-4e8f-a7f7-f9c0c7c0d839") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:11.053150 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:11.053117 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:11.053328 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:11.053266 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:11.054020 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:11.053655 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:11.054020 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:11.053806 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:11.054020 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:11.053851 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:11.054020 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:11.053921 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:11.092795 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:11.092757 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" event={"ID":"ed28e8a4decff07b78d23c796a5cc5e4","Type":"ContainerStarted","Data":"55c98bb189dc736ed083fa161ee6b5a3adfeece0ff075651533771d616f822ea"} Sep 17 08:24:11.107927 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:11.107870 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-148.ec2.internal" podStartSLOduration=5.107853625 podStartE2EDuration="5.107853625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:10.105241797 +0000 UTC m=+5.572754081" watchObservedRunningTime="2026-09-17 08:24:11.107853625 +0000 UTC m=+6.575365907" Sep 17 08:24:13.053517 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:13.053485 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:13.053961 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:13.053613 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:13.054032 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:13.054017 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:13.054131 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:13.054104 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:13.054180 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:13.054162 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:13.054263 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:13.054242 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:13.099740 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:13.099700 2580 generic.go:356] "Generic (PLEG): container finished" podID="ed28e8a4decff07b78d23c796a5cc5e4" containerID="55c98bb189dc736ed083fa161ee6b5a3adfeece0ff075651533771d616f822ea" exitCode=0 Sep 17 08:24:13.099943 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:13.099756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" event={"ID":"ed28e8a4decff07b78d23c796a5cc5e4","Type":"ContainerDied","Data":"55c98bb189dc736ed083fa161ee6b5a3adfeece0ff075651533771d616f822ea"} Sep 17 08:24:14.616044 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:14.616001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:14.616531 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:14.616055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:14.616531 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:14.616159 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:14.616531 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:14.616178 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:14.616531 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:14.616228 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret podName:a141cbb6-0bb2-4cc8-b905-5f2cd1f28824 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:22.616213543 +0000 UTC m=+18.083725802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret") pod "global-pull-secret-syncer-bn7qh" (UID: "a141cbb6-0bb2-4cc8-b905-5f2cd1f28824") : object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:14.616531 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:14.616241 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs podName:edc69206-7d0f-4086-964c-77facc99d777 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:22.616234652 +0000 UTC m=+18.083746911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs") pod "network-metrics-daemon-xjrm2" (UID: "edc69206-7d0f-4086-964c-77facc99d777") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:14.817130 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:14.817090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:14.817293 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:14.817279 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 08:24:14.817363 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:14.817299 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 08:24:14.817363 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:14.817312 2580 projected.go:196] Error preparing data for projected volume kube-api-access-b8gfw for pod openshift-network-diagnostics/network-check-target-q4gsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:14.817462 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:14.817373 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw podName:fd354192-24d2-4e8f-a7f7-f9c0c7c0d839 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:22.817354958 +0000 UTC m=+18.284867222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8gfw" (UniqueName: "kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw") pod "network-check-target-q4gsh" (UID: "fd354192-24d2-4e8f-a7f7-f9c0c7c0d839") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:15.051897 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:15.051701 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:15.052048 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:15.051993 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:15.052394 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:15.052365 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:15.052498 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:15.052468 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:15.053407 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:15.053378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:15.053499 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:15.053483 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:17.051308 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:17.051273 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:17.051308 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:17.051290 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:17.051308 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:17.051298 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:17.051829 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:17.051390 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:17.051829 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:17.051467 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:17.051829 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:17.051679 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:19.053403 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:19.053368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:19.053403 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:19.053382 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:19.053872 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:19.053368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:19.053872 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:19.053485 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:19.053872 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:19.053540 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:19.053872 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:19.053640 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:21.050812 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:21.050773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:21.051281 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:21.050773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:21.051281 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:21.050931 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:21.051281 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:21.050975 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:21.051281 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:21.051090 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:21.051281 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:21.051184 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:22.675232 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:22.675199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:22.675232 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:22.675245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:22.675809 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:22.675371 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:22.675809 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:22.675395 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:22.675809 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:22.675445 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs podName:edc69206-7d0f-4086-964c-77facc99d777 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:38.67542944 +0000 UTC m=+34.142941699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs") pod "network-metrics-daemon-xjrm2" (UID: "edc69206-7d0f-4086-964c-77facc99d777") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:22.675809 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:22.675461 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret podName:a141cbb6-0bb2-4cc8-b905-5f2cd1f28824 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:38.67545501 +0000 UTC m=+34.142967270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret") pod "global-pull-secret-syncer-bn7qh" (UID: "a141cbb6-0bb2-4cc8-b905-5f2cd1f28824") : object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:22.876911 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:22.876869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:22.877081 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:22.877048 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 08:24:22.877081 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:22.877074 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 08:24:22.877177 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:22.877085 2580 projected.go:196] Error preparing data for projected volume kube-api-access-b8gfw for pod openshift-network-diagnostics/network-check-target-q4gsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:22.877177 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:22.877142 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw podName:fd354192-24d2-4e8f-a7f7-f9c0c7c0d839 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:38.87712846 +0000 UTC m=+34.344640740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8gfw" (UniqueName: "kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw") pod "network-check-target-q4gsh" (UID: "fd354192-24d2-4e8f-a7f7-f9c0c7c0d839") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:23.054670 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:23.054635 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:23.054828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:23.054760 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:23.054828 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:23.054781 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:23.054828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:23.054794 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:23.054977 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:23.054881 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:23.055024 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:23.054971 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:25.052284 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:25.051760 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:25.052284 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:25.051874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:25.052284 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:25.051888 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:25.052284 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:25.052001 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:25.052284 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:25.052050 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:25.052284 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:25.052105 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:26.133838 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.133570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9r77w" event={"ID":"76fa79c8-f383-45bb-8f79-31a592ed0239","Type":"ContainerStarted","Data":"92d2d943993a00e1ea8c408b65f3f6d36cf3d05a3b024c0d7405cd050cc3ff93"} Sep 17 08:24:26.135998 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.135939 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gphn5" event={"ID":"dab4b815-e4b7-4b19-a4c9-9ae24bd453a8","Type":"ContainerStarted","Data":"3fab4d24310b43e225e55188babd41ad146453a6cce2d9b4211f3f4252553479"} Sep 17 08:24:26.137877 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.137850 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6dks4" event={"ID":"179a10c1-4d7a-4055-aace-6dec464d4097","Type":"ContainerStarted","Data":"df70f5c6c6a0da54890770dbb9a8e8d59a5b9b3a27b071d9c47eee088d589cc5"} Sep 17 08:24:26.140140 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.139979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" event={"ID":"6e720820-bb49-4fc7-97a5-b7171e9b7e14","Type":"ContainerStarted","Data":"500e6a008ff8f019b842ac441701177561bcc3a483fe5a73b0aaeeb8e7e637d3"} Sep 17 08:24:26.141966 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.141945 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gzg8r" event={"ID":"2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1","Type":"ContainerStarted","Data":"57d99ee579bcb1974b9858b987e8071c2c5cd718713eb3020fc7d8e43995c3ec"} Sep 17 08:24:26.144383 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.144363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" event={"ID":"ed28e8a4decff07b78d23c796a5cc5e4","Type":"ContainerStarted","Data":"8c6fa8f4b102a01227ba898bba0fc1fbb562e65ccb620094a5e3efb0fec22fc7"} Sep 17 08:24:26.147063 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.147015 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" event={"ID":"544118fc-af72-4f25-aeb3-6f43c91e993e","Type":"ContainerStarted","Data":"50ed82af176521f4ee4f2ef270b3b74b2b80fe99ab1ca8c541cda02972e3d27f"} Sep 17 08:24:26.147465 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.147339 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9r77w" podStartSLOduration=2.58451959 podStartE2EDuration="21.147328018s" totalImagesPullingTime="18.562808428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:26.147102412 +0000 UTC m=+21.614614695" watchObservedRunningTime="2026-09-17 08:24:26.147328018 +0000 UTC m=+21.614840299" Sep 17 08:24:26.155715 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.152915 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-92xqx" event={"ID":"5e248508-31ae-4055-9d00-3359ff5d67dc","Type":"ContainerStarted","Data":"e7f28750031ef697712e508dbab432a17db067137452a73037e935176486996f"} Sep 17 08:24:26.156350 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.156321 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" event={"ID":"b64902d3-2e97-4fa9-b338-e20f0b864036","Type":"ContainerStarted","Data":"ee044d1dc8fafa003064cc28cfa53a95d29ea464eca6d21c30ac9b14e659d9bf"} Sep 17 08:24:26.164251 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.163604 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6dks4" podStartSLOduration=2.789774937 podStartE2EDuration="21.16359253s" totalImagesPullingTime="18.373817593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:26.163317878 +0000 UTC m=+21.630830159" watchObservedRunningTime="2026-09-17 08:24:26.16359253 +0000 UTC m=+21.631104811" Sep 17 08:24:26.179978 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.179918 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gphn5" podStartSLOduration=2.6131186299999998 podStartE2EDuration="21.179897195s" totalImagesPullingTime="18.566778565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:26.1789163 +0000 UTC m=+21.646428582" watchObservedRunningTime="2026-09-17 08:24:26.179897195 +0000 UTC m=+21.647409478" Sep 17 08:24:26.194280 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.194223 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-148.ec2.internal" podStartSLOduration=20.194202192 podStartE2EDuration="20.194202192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:26.193858436 +0000 UTC m=+21.661370719" watchObservedRunningTime="2026-09-17 08:24:26.194202192 +0000 UTC m=+21.661714475" Sep 17 08:24:26.212199 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.212155 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gzg8r" podStartSLOduration=2.534372371 podStartE2EDuration="21.212138737s" totalImagesPullingTime="18.677766366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:26.212049751 +0000 UTC m=+21.679562033" watchObservedRunningTime="2026-09-17 08:24:26.212138737 +0000 UTC m=+21.679651019" Sep 17 08:24:26.255074 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:26.255024 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-92xqx" podStartSLOduration=2.668117814 podStartE2EDuration="21.255007191s" totalImagesPullingTime="18.586889377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:26.254656169 +0000 UTC m=+21.722168451" watchObservedRunningTime="2026-09-17 08:24:26.255007191 +0000 UTC m=+21.722519473" Sep 17 08:24:27.051526 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.051497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:27.051727 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.051559 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:27.051727 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.051573 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:27.051727 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:27.051707 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:27.051861 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:27.051780 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:27.051861 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:27.051818 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:27.160066 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.159970 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sx2lz" event={"ID":"6f15278e-dac9-4be3-9d3b-e09d5b36fb6a","Type":"ContainerStarted","Data":"fb9983e8ca3bc5e06ec0c4de8e32aab32840d5e9d9b3796aa513c42a5fd2dd7a"} Sep 17 08:24:27.161873 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.161844 2580 generic.go:356] "Generic (PLEG): container finished" podID="544118fc-af72-4f25-aeb3-6f43c91e993e" containerID="50ed82af176521f4ee4f2ef270b3b74b2b80fe99ab1ca8c541cda02972e3d27f" exitCode=0 Sep 17 08:24:27.161986 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.161936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" event={"ID":"544118fc-af72-4f25-aeb3-6f43c91e993e","Type":"ContainerDied","Data":"50ed82af176521f4ee4f2ef270b3b74b2b80fe99ab1ca8c541cda02972e3d27f"} Sep 17 08:24:27.169037 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.169008 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" event={"ID":"b64902d3-2e97-4fa9-b338-e20f0b864036","Type":"ContainerStarted","Data":"c1b3a3c1f84e2e26d1a8c622cfb58dbf21c42ed2f7dbb53f1332d9dac7029dba"} Sep 17 08:24:27.169159 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.169120 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" event={"ID":"b64902d3-2e97-4fa9-b338-e20f0b864036","Type":"ContainerStarted","Data":"576cec551c09f92607521b550b4af6f677d95fb0c8c5a64327d21619f2d041ae"} Sep 17 08:24:27.169228 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.169180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" event={"ID":"b64902d3-2e97-4fa9-b338-e20f0b864036","Type":"ContainerStarted","Data":"e5f19c78403f3a3e1da45920c4ce7d35f8488e1febde988d4b5926426043af5e"} Sep 17 08:24:27.169286 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.169228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" event={"ID":"b64902d3-2e97-4fa9-b338-e20f0b864036","Type":"ContainerStarted","Data":"36a49359177e3034e7ed0039f0514ae899ff37e51ab024b04d76a77be96f8edc"} Sep 17 08:24:27.169286 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.169281 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" event={"ID":"b64902d3-2e97-4fa9-b338-e20f0b864036","Type":"ContainerStarted","Data":"01765c957b091fde2cb3ced664bdb4284ad823d78b238f69bfcf3bc18147f5f5"} Sep 17 08:24:27.178530 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.178482 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sx2lz" podStartSLOduration=3.7764568819999997 podStartE2EDuration="22.178465217s" totalImagesPullingTime="18.402008335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:27.178055293 +0000 UTC m=+22.645567575" watchObservedRunningTime="2026-09-17 08:24:27.178465217 +0000 UTC m=+22.645977500" Sep 17 08:24:27.568108 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.568074 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:27.568793 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.568777 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:27.873247 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:27.873079 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 08:24:28.009196 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:28.009059 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T08:24:27.873240766Z","UUID":"382d0472-ac38-4904-a342-7a74c694f65f","Handler":null,"Name":"","Endpoint":""} Sep 17 08:24:28.010636 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:28.010604 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 08:24:28.010756 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:28.010654 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 08:24:28.173778 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:28.173696 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" event={"ID":"6e720820-bb49-4fc7-97a5-b7171e9b7e14","Type":"ContainerStarted","Data":"62dcca863a17000ef72fea506bea9aa21b04e3e5b2cbaef588f063501f781bd0"} Sep 17 08:24:29.051608 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:29.051579 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:29.051780 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:29.051582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:29.051780 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:29.051734 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:29.051875 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:29.051798 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:29.051875 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:29.051801 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:29.051979 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:29.051920 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:29.180920 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:29.180890 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 08:24:29.180920 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:29.180913 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" event={"ID":"b64902d3-2e97-4fa9-b338-e20f0b864036","Type":"ContainerStarted","Data":"f0448425bc0bf79e724bd4cb5beb7c31278a949c70ed8579279e19ffe1ca8d3a"} Sep 17 08:24:30.186432 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:30.186383 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" event={"ID":"6e720820-bb49-4fc7-97a5-b7171e9b7e14","Type":"ContainerStarted","Data":"61be619e773bfe308e935174a2868ffa30afb08bec18f280308a8457f925c4d7"} Sep 17 08:24:30.203823 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:30.203771 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvb98" podStartSLOduration=3.621704609 podStartE2EDuration="25.203757111s" totalImagesPullingTime="21.582052502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:30.203577155 +0000 UTC m=+25.671089437" watchObservedRunningTime="2026-09-17 08:24:30.203757111 +0000 UTC m=+25.671269392" Sep 17 08:24:31.051692 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:31.051453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:31.051918 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:31.051544 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:31.051918 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:31.051787 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:31.051918 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:31.051834 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:31.051918 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:31.051613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:31.052075 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:31.051949 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:31.192802 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:31.192709 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" event={"ID":"b64902d3-2e97-4fa9-b338-e20f0b864036","Type":"ContainerStarted","Data":"f13c7c83ab1a69e2dd7afabae1d484eada2a6b5b9591bef412c94fb46a1edc22"} Sep 17 08:24:31.221493 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:31.221441 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" podStartSLOduration=7.572572102 podStartE2EDuration="26.221417795s" totalImagesPullingTime="18.648845693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:31.220882393 +0000 UTC m=+26.688394676" watchObservedRunningTime="2026-09-17 08:24:31.221417795 +0000 UTC m=+26.688930076" Sep 17 08:24:32.196021 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.195995 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:32.196533 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.196072 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:32.196533 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.196122 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:32.214157 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.214116 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:32.215155 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.215130 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:24:32.671177 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.671144 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q4gsh"] Sep 17 08:24:32.671362 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.671310 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:32.671434 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:32.671415 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:32.673880 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.673853 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bn7qh"] Sep 17 08:24:32.674009 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.673960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:32.674077 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:32.674048 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:32.676426 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.676402 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xjrm2"] Sep 17 08:24:32.676608 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:32.676518 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:32.676705 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:32.676645 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:34.051271 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:34.051240 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:34.051911 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:34.051350 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:34.202476 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:34.202441 2580 generic.go:356] "Generic (PLEG): container finished" podID="544118fc-af72-4f25-aeb3-6f43c91e993e" containerID="05e4e88fa510637944f16dd6c6ce70e49a7cbdeca98476439aa65c683207ef7f" exitCode=0 Sep 17 08:24:34.202666 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:34.202532 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" event={"ID":"544118fc-af72-4f25-aeb3-6f43c91e993e","Type":"ContainerDied","Data":"05e4e88fa510637944f16dd6c6ce70e49a7cbdeca98476439aa65c683207ef7f"} Sep 17 08:24:34.797009 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:34.796979 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:34.797176 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:34.797158 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 08:24:34.797681 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:34.797662 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gphn5" Sep 17 08:24:35.052354 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:35.052326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:35.052784 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:35.052452 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:35.052784 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:35.052500 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:35.052784 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:35.052615 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:36.050826 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:36.050643 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:36.050971 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:36.050896 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:36.208934 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:36.208900 2580 generic.go:356] "Generic (PLEG): container finished" podID="544118fc-af72-4f25-aeb3-6f43c91e993e" containerID="37aeb96fb912462d277753f8610ada8778cfd06e0ab9083d43e371a95221332c" exitCode=0 Sep 17 08:24:36.209289 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:36.208962 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" event={"ID":"544118fc-af72-4f25-aeb3-6f43c91e993e","Type":"ContainerDied","Data":"37aeb96fb912462d277753f8610ada8778cfd06e0ab9083d43e371a95221332c"} Sep 17 08:24:37.051844 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:37.051811 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:37.052005 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:37.051930 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjrm2" podUID="edc69206-7d0f-4086-964c-77facc99d777" Sep 17 08:24:37.052005 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:37.051960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:37.052079 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:37.052015 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4gsh" podUID="fd354192-24d2-4e8f-a7f7-f9c0c7c0d839" Sep 17 08:24:38.051209 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.051182 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:38.051670 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:38.051305 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bn7qh" podUID="a141cbb6-0bb2-4cc8-b905-5f2cd1f28824" Sep 17 08:24:38.215918 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.215889 2580 generic.go:356] "Generic (PLEG): container finished" podID="544118fc-af72-4f25-aeb3-6f43c91e993e" containerID="3c234b7a1a9526df17762fddf0aa86506fd5d4302e2217da54bf4e546821c50e" exitCode=0 Sep 17 08:24:38.216052 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.215934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" event={"ID":"544118fc-af72-4f25-aeb3-6f43c91e993e","Type":"ContainerDied","Data":"3c234b7a1a9526df17762fddf0aa86506fd5d4302e2217da54bf4e546821c50e"} Sep 17 08:24:38.688161 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.688139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:38.688245 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.688172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:38.688291 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:38.688274 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:38.688347 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:38.688337 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs podName:edc69206-7d0f-4086-964c-77facc99d777 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:10.688323113 +0000 UTC m=+66.155835372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs") pod "network-metrics-daemon-xjrm2" (UID: "edc69206-7d0f-4086-964c-77facc99d777") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 08:24:38.688395 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:38.688274 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:38.688431 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:38.688411 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret podName:a141cbb6-0bb2-4cc8-b905-5f2cd1f28824 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:10.688400063 +0000 UTC m=+66.155912325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret") pod "global-pull-secret-syncer-bn7qh" (UID: "a141cbb6-0bb2-4cc8-b905-5f2cd1f28824") : object "kube-system"/"original-pull-secret" not registered Sep 17 08:24:38.848288 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.848262 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-148.ec2.internal" event="NodeReady" Sep 17 08:24:38.848445 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.848391 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 08:24:38.881430 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.881384 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fd69d4f5b-mmkh7"] Sep 17 08:24:38.885390 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.885349 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:38.888115 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.888003 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 08:24:38.888115 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.888095 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 08:24:38.888334 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.888095 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m5gxp\"" Sep 17 08:24:38.888334 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.888133 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 08:24:38.890158 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.890137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:38.890306 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:38.890289 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 08:24:38.890363 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:38.890313 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 08:24:38.890363 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:38.890327 2580 projected.go:196] Error preparing data for projected volume kube-api-access-b8gfw for pod openshift-network-diagnostics/network-check-target-q4gsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:38.890483 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:38.890375 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw podName:fd354192-24d2-4e8f-a7f7-f9c0c7c0d839 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:10.89035938 +0000 UTC m=+66.357871662 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8gfw" (UniqueName: "kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw") pod "network-check-target-q4gsh" (UID: "fd354192-24d2-4e8f-a7f7-f9c0c7c0d839") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 08:24:38.895596 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.895567 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 08:24:38.900989 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.900277 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dlqhq"] Sep 17 08:24:38.905281 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.905254 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd69d4f5b-mmkh7"] Sep 17 08:24:38.905388 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.905292 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bp954"] Sep 17 08:24:38.905388 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.905368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:38.907791 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.907767 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 08:24:38.907952 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.907930 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdz5j\"" Sep 17 08:24:38.908107 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.908001 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 08:24:38.908922 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.908905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bp954" Sep 17 08:24:38.911944 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.911920 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dlqhq"] Sep 17 08:24:38.912236 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.912217 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5wrj5\"" Sep 17 08:24:38.912480 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.912465 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 08:24:38.912717 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.912702 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 08:24:38.912964 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.912896 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 08:24:38.914317 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.914293 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bp954"] Sep 17 08:24:38.990853 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.990771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc8fv\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-kube-api-access-zc8fv\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:38.990853 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.990825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db72abcf-53e6-49be-93dc-2de5d216afb5-ca-trust-extracted\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:38.991062 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.990856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-certificates\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:38.991062 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.990885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-trusted-ca\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:38.991062 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.990918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:38.991062 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.990963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-bound-sa-token\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:38.991062 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.990996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50a808da-fe8f-434a-be74-e7ac5abaf4fe-config-volume\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:38.991062 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.991056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a808da-fe8f-434a-be74-e7ac5abaf4fe-tmp-dir\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:38.991281 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.991100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-image-registry-private-configuration\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:38.991281 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.991127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e53d483-78b4-4663-bd41-2efdef4ad6fe-cert\") pod \"ingress-canary-bp954\" (UID: \"1e53d483-78b4-4663-bd41-2efdef4ad6fe\") " pod="openshift-ingress-canary/ingress-canary-bp954" Sep 17 08:24:38.991281 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.991190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:38.991281 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.991232 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k9tb\" (UniqueName: \"kubernetes.io/projected/50a808da-fe8f-434a-be74-e7ac5abaf4fe-kube-api-access-8k9tb\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:38.991281 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.991255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrf8r\" (UniqueName: \"kubernetes.io/projected/1e53d483-78b4-4663-bd41-2efdef4ad6fe-kube-api-access-nrf8r\") pod \"ingress-canary-bp954\" (UID: \"1e53d483-78b4-4663-bd41-2efdef4ad6fe\") " pod="openshift-ingress-canary/ingress-canary-bp954" Sep 17 08:24:38.991281 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:38.991281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-installation-pull-secrets\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.051287 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.051249 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:24:39.051729 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.051462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:24:39.054523 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.054500 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 08:24:39.054658 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.054521 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lfcxg\"" Sep 17 08:24:39.054658 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.054523 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gmdck\"" Sep 17 08:24:39.054658 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.054500 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 08:24:39.054818 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.054527 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 08:24:39.092305 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k9tb\" (UniqueName: \"kubernetes.io/projected/50a808da-fe8f-434a-be74-e7ac5abaf4fe-kube-api-access-8k9tb\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:39.092305 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrf8r\" (UniqueName: \"kubernetes.io/projected/1e53d483-78b4-4663-bd41-2efdef4ad6fe-kube-api-access-nrf8r\") pod \"ingress-canary-bp954\" (UID: \"1e53d483-78b4-4663-bd41-2efdef4ad6fe\") " pod="openshift-ingress-canary/ingress-canary-bp954" Sep 17 08:24:39.092441 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-installation-pull-secrets\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.092676 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc8fv\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-kube-api-access-zc8fv\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.092743 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db72abcf-53e6-49be-93dc-2de5d216afb5-ca-trust-extracted\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.092743 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092696 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-certificates\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.092743 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-trusted-ca\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.092857 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.092857 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-bound-sa-token\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.092857 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50a808da-fe8f-434a-be74-e7ac5abaf4fe-config-volume\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:39.092857 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a808da-fe8f-434a-be74-e7ac5abaf4fe-tmp-dir\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:39.092857 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.092834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-image-registry-private-configuration\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.093098 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.092864 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 08:24:39.093098 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.092880 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69d4f5b-mmkh7: secret "image-registry-tls" not found Sep 17 08:24:39.093098 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.092938 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls podName:db72abcf-53e6-49be-93dc-2de5d216afb5 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:39.592914216 +0000 UTC m=+35.060426476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls") pod "image-registry-5fd69d4f5b-mmkh7" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5") : secret "image-registry-tls" not found Sep 17 08:24:39.093098 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.093079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db72abcf-53e6-49be-93dc-2de5d216afb5-ca-trust-extracted\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.093291 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.093113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e53d483-78b4-4663-bd41-2efdef4ad6fe-cert\") pod \"ingress-canary-bp954\" (UID: \"1e53d483-78b4-4663-bd41-2efdef4ad6fe\") " pod="openshift-ingress-canary/ingress-canary-bp954" Sep 17 08:24:39.093291 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.093160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:39.093387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.093318 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50a808da-fe8f-434a-be74-e7ac5abaf4fe-tmp-dir\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:39.093387 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.093347 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 08:24:39.093387 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.093388 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls podName:50a808da-fe8f-434a-be74-e7ac5abaf4fe nodeName:}" failed. No retries permitted until 2026-09-17 08:24:39.593375953 +0000 UTC m=+35.060888213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls") pod "dns-default-dlqhq" (UID: "50a808da-fe8f-434a-be74-e7ac5abaf4fe") : secret "dns-default-metrics-tls" not found Sep 17 08:24:39.093541 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.093459 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50a808da-fe8f-434a-be74-e7ac5abaf4fe-config-volume\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:39.093667 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.093642 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-certificates\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.093901 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.093881 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-trusted-ca\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.096691 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.096672 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-installation-pull-secrets\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.096778 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.096692 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e53d483-78b4-4663-bd41-2efdef4ad6fe-cert\") pod \"ingress-canary-bp954\" (UID: \"1e53d483-78b4-4663-bd41-2efdef4ad6fe\") " pod="openshift-ingress-canary/ingress-canary-bp954" Sep 17 08:24:39.096778 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.096742 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-image-registry-private-configuration\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.101553 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.101531 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-bound-sa-token\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.101799 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.101775 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k9tb\" (UniqueName: \"kubernetes.io/projected/50a808da-fe8f-434a-be74-e7ac5abaf4fe-kube-api-access-8k9tb\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:39.101891 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.101872 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc8fv\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-kube-api-access-zc8fv\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.102631 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.102595 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrf8r\" (UniqueName: \"kubernetes.io/projected/1e53d483-78b4-4663-bd41-2efdef4ad6fe-kube-api-access-nrf8r\") pod \"ingress-canary-bp954\" (UID: \"1e53d483-78b4-4663-bd41-2efdef4ad6fe\") " pod="openshift-ingress-canary/ingress-canary-bp954" Sep 17 08:24:39.223926 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.223895 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bp954" Sep 17 08:24:39.508332 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.508002 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bp954"] Sep 17 08:24:39.512048 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:39.512016 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e53d483_78b4_4663_bd41_2efdef4ad6fe.slice/crio-85e194f7f53412fba10776a98a46bc78536059c6826eb88afd812c23c18fdac3 WatchSource:0}: Error finding container 85e194f7f53412fba10776a98a46bc78536059c6826eb88afd812c23c18fdac3: Status 404 returned error can't find the container with id 85e194f7f53412fba10776a98a46bc78536059c6826eb88afd812c23c18fdac3 Sep 17 08:24:39.598076 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.598041 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:39.598226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:39.598100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:39.598226 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.598198 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 08:24:39.598226 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.598217 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69d4f5b-mmkh7: secret "image-registry-tls" not found Sep 17 08:24:39.598381 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.598237 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 08:24:39.598381 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.598276 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls podName:db72abcf-53e6-49be-93dc-2de5d216afb5 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:40.598258927 +0000 UTC m=+36.065771201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls") pod "image-registry-5fd69d4f5b-mmkh7" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5") : secret "image-registry-tls" not found Sep 17 08:24:39.598381 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:39.598290 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls podName:50a808da-fe8f-434a-be74-e7ac5abaf4fe nodeName:}" failed. No retries permitted until 2026-09-17 08:24:40.598283572 +0000 UTC m=+36.065795833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls") pod "dns-default-dlqhq" (UID: "50a808da-fe8f-434a-be74-e7ac5abaf4fe") : secret "dns-default-metrics-tls" not found Sep 17 08:24:40.050742 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:40.050705 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:24:40.053409 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:40.053389 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 08:24:40.221738 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:40.221703 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bp954" event={"ID":"1e53d483-78b4-4663-bd41-2efdef4ad6fe","Type":"ContainerStarted","Data":"85e194f7f53412fba10776a98a46bc78536059c6826eb88afd812c23c18fdac3"} Sep 17 08:24:40.605678 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:40.605637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:40.605868 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:40.605722 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:40.605868 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:40.605807 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 08:24:40.605868 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:40.605843 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69d4f5b-mmkh7: secret "image-registry-tls" not found Sep 17 08:24:40.605868 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:40.605844 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 08:24:40.606034 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:40.605913 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls podName:50a808da-fe8f-434a-be74-e7ac5abaf4fe nodeName:}" failed. No retries permitted until 2026-09-17 08:24:42.605892731 +0000 UTC m=+38.073404993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls") pod "dns-default-dlqhq" (UID: "50a808da-fe8f-434a-be74-e7ac5abaf4fe") : secret "dns-default-metrics-tls" not found Sep 17 08:24:40.606034 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:40.605931 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls podName:db72abcf-53e6-49be-93dc-2de5d216afb5 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:42.605921914 +0000 UTC m=+38.073434180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls") pod "image-registry-5fd69d4f5b-mmkh7" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5") : secret "image-registry-tls" not found Sep 17 08:24:42.622041 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:42.622001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:42.622650 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:42.622055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:42.622650 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:42.622168 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 08:24:42.622650 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:42.622186 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69d4f5b-mmkh7: secret "image-registry-tls" not found Sep 17 08:24:42.622650 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:42.622187 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 08:24:42.622650 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:42.622253 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls podName:db72abcf-53e6-49be-93dc-2de5d216afb5 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:46.622232993 +0000 UTC m=+42.089745252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls") pod "image-registry-5fd69d4f5b-mmkh7" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5") : secret "image-registry-tls" not found Sep 17 08:24:42.622650 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:42.622271 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls podName:50a808da-fe8f-434a-be74-e7ac5abaf4fe nodeName:}" failed. No retries permitted until 2026-09-17 08:24:46.622264359 +0000 UTC m=+42.089776619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls") pod "dns-default-dlqhq" (UID: "50a808da-fe8f-434a-be74-e7ac5abaf4fe") : secret "dns-default-metrics-tls" not found Sep 17 08:24:45.235076 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:45.234982 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bp954" event={"ID":"1e53d483-78b4-4663-bd41-2efdef4ad6fe","Type":"ContainerStarted","Data":"eca46337b5c464ed926fe7db5b3516492d66c1b93f3b947ab53f30123cf96256"} Sep 17 08:24:45.238173 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:45.238149 2580 generic.go:356] "Generic (PLEG): container finished" podID="544118fc-af72-4f25-aeb3-6f43c91e993e" containerID="f3515e060dfa58109dec4210a50f1eeb72f5a3ba81e5040d59dae1030580360e" exitCode=0 Sep 17 08:24:45.238286 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:45.238196 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" event={"ID":"544118fc-af72-4f25-aeb3-6f43c91e993e","Type":"ContainerDied","Data":"f3515e060dfa58109dec4210a50f1eeb72f5a3ba81e5040d59dae1030580360e"} Sep 17 08:24:45.250538 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:45.250494 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bp954" podStartSLOduration=2.14032079 podStartE2EDuration="7.250481281s" totalImagesPullingTime="5.110160491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:45.250118357 +0000 UTC m=+40.717630638" watchObservedRunningTime="2026-09-17 08:24:45.250481281 +0000 UTC m=+40.717993562" Sep 17 08:24:46.243977 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:46.243944 2580 generic.go:356] "Generic (PLEG): container finished" podID="544118fc-af72-4f25-aeb3-6f43c91e993e" containerID="e74b30e1fcf097044b7191a675c5d1e88b40482cf0ca84e7546d45e001d03ffd" exitCode=0 Sep 17 08:24:46.244367 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:46.244040 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" event={"ID":"544118fc-af72-4f25-aeb3-6f43c91e993e","Type":"ContainerDied","Data":"e74b30e1fcf097044b7191a675c5d1e88b40482cf0ca84e7546d45e001d03ffd"} Sep 17 08:24:46.651917 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:46.651882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:46.652105 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:46.651956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:46.652105 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:46.652045 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 08:24:46.652105 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:46.652050 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 08:24:46.652256 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:46.652124 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls podName:50a808da-fe8f-434a-be74-e7ac5abaf4fe nodeName:}" failed. No retries permitted until 2026-09-17 08:24:54.652102149 +0000 UTC m=+50.119614411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls") pod "dns-default-dlqhq" (UID: "50a808da-fe8f-434a-be74-e7ac5abaf4fe") : secret "dns-default-metrics-tls" not found Sep 17 08:24:46.652256 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:46.652056 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69d4f5b-mmkh7: secret "image-registry-tls" not found Sep 17 08:24:46.652256 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:46.652177 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls podName:db72abcf-53e6-49be-93dc-2de5d216afb5 nodeName:}" failed. No retries permitted until 2026-09-17 08:24:54.652166744 +0000 UTC m=+50.119679004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls") pod "image-registry-5fd69d4f5b-mmkh7" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5") : secret "image-registry-tls" not found Sep 17 08:24:47.249584 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:47.249549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" event={"ID":"544118fc-af72-4f25-aeb3-6f43c91e993e","Type":"ContainerStarted","Data":"c1e6563896a9c60bba7c3f7ea93c04a9c76e7b47d2776a9e149a3ab72bc0ea54"} Sep 17 08:24:47.271864 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:47.271809 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c6bjp" podStartSLOduration=8.891629114 podStartE2EDuration="42.27179354s" totalImagesPullingTime="33.380164426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:47.270101368 +0000 UTC m=+42.737613651" watchObservedRunningTime="2026-09-17 08:24:47.27179354 +0000 UTC m=+42.739305821" Sep 17 08:24:54.711151 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:54.711108 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:24:54.711524 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:54.711185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:24:54.711524 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:54.711268 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 08:24:54.711524 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:54.711297 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 08:24:54.711524 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:54.711317 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69d4f5b-mmkh7: secret "image-registry-tls" not found Sep 17 08:24:54.711524 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:54.711333 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls podName:50a808da-fe8f-434a-be74-e7ac5abaf4fe nodeName:}" failed. No retries permitted until 2026-09-17 08:25:10.711317308 +0000 UTC m=+66.178829568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls") pod "dns-default-dlqhq" (UID: "50a808da-fe8f-434a-be74-e7ac5abaf4fe") : secret "dns-default-metrics-tls" not found Sep 17 08:24:54.711524 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:24:54.711370 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls podName:db72abcf-53e6-49be-93dc-2de5d216afb5 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:10.711357469 +0000 UTC m=+66.178869729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls") pod "image-registry-5fd69d4f5b-mmkh7" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5") : secret "image-registry-tls" not found Sep 17 08:24:57.394303 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.394269 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4"] Sep 17 08:24:57.416783 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.416759 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4"] Sep 17 08:24:57.416930 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.416846 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4" Sep 17 08:24:57.419375 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.419343 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q25fq\"" Sep 17 08:24:57.496386 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.496354 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f"] Sep 17 08:24:57.513248 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.513224 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f" Sep 17 08:24:57.515177 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.515153 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f"] Sep 17 08:24:57.517396 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.517380 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 08:24:57.517517 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.517438 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wt64q\"" Sep 17 08:24:57.517601 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.517578 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 08:24:57.532531 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.532507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj485\" (UniqueName: \"kubernetes.io/projected/bdd47568-8625-48a7-976f-2da66bd80738-kube-api-access-kj485\") pod \"network-check-source-6f8b768455-z6jr4\" (UID: \"bdd47568-8625-48a7-976f-2da66bd80738\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4" Sep 17 08:24:57.633748 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.633717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw2xt\" (UniqueName: \"kubernetes.io/projected/ac9d2ed0-2819-45e4-92fb-c67c6260f6d0-kube-api-access-cw2xt\") pod \"volume-data-source-validator-86695b7cc7-8qr4f\" (UID: \"ac9d2ed0-2819-45e4-92fb-c67c6260f6d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f" Sep 17 08:24:57.633916 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.633796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj485\" (UniqueName: \"kubernetes.io/projected/bdd47568-8625-48a7-976f-2da66bd80738-kube-api-access-kj485\") pod \"network-check-source-6f8b768455-z6jr4\" (UID: \"bdd47568-8625-48a7-976f-2da66bd80738\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4" Sep 17 08:24:57.650374 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.650316 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj485\" (UniqueName: \"kubernetes.io/projected/bdd47568-8625-48a7-976f-2da66bd80738-kube-api-access-kj485\") pod \"network-check-source-6f8b768455-z6jr4\" (UID: \"bdd47568-8625-48a7-976f-2da66bd80738\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4" Sep 17 08:24:57.724476 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.724446 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4" Sep 17 08:24:57.734795 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.734765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw2xt\" (UniqueName: \"kubernetes.io/projected/ac9d2ed0-2819-45e4-92fb-c67c6260f6d0-kube-api-access-cw2xt\") pod \"volume-data-source-validator-86695b7cc7-8qr4f\" (UID: \"ac9d2ed0-2819-45e4-92fb-c67c6260f6d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f" Sep 17 08:24:57.744478 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.744459 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw2xt\" (UniqueName: \"kubernetes.io/projected/ac9d2ed0-2819-45e4-92fb-c67c6260f6d0-kube-api-access-cw2xt\") pod \"volume-data-source-validator-86695b7cc7-8qr4f\" (UID: \"ac9d2ed0-2819-45e4-92fb-c67c6260f6d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f" Sep 17 08:24:57.823202 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:57.823166 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f" Sep 17 08:24:58.010511 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:58.010437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4"] Sep 17 08:24:58.013911 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:58.013887 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd47568_8625_48a7_976f_2da66bd80738.slice/crio-588827b65198784d2cf4f028acfd7e91c84765477a5c20949fe04187566a1eaa WatchSource:0}: Error finding container 588827b65198784d2cf4f028acfd7e91c84765477a5c20949fe04187566a1eaa: Status 404 returned error can't find the container with id 588827b65198784d2cf4f028acfd7e91c84765477a5c20949fe04187566a1eaa Sep 17 08:24:58.102590 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:58.102557 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f"] Sep 17 08:24:58.105022 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:24:58.104984 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9d2ed0_2819_45e4_92fb_c67c6260f6d0.slice/crio-d8b90641a75afb1a952e39e028397372b4261c239393ae06f9a3d350fa8be2e5 WatchSource:0}: Error finding container d8b90641a75afb1a952e39e028397372b4261c239393ae06f9a3d350fa8be2e5: Status 404 returned error can't find the container with id d8b90641a75afb1a952e39e028397372b4261c239393ae06f9a3d350fa8be2e5 Sep 17 08:24:58.275459 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:58.275374 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f" event={"ID":"ac9d2ed0-2819-45e4-92fb-c67c6260f6d0","Type":"ContainerStarted","Data":"d8b90641a75afb1a952e39e028397372b4261c239393ae06f9a3d350fa8be2e5"} Sep 17 08:24:58.276469 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:58.276448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4" event={"ID":"bdd47568-8625-48a7-976f-2da66bd80738","Type":"ContainerStarted","Data":"588827b65198784d2cf4f028acfd7e91c84765477a5c20949fe04187566a1eaa"} Sep 17 08:24:59.280537 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:59.280500 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f" event={"ID":"ac9d2ed0-2819-45e4-92fb-c67c6260f6d0","Type":"ContainerStarted","Data":"de90c67f2460b2248646215ab8e8edd22be17f944a1890346609e494231c50f5"} Sep 17 08:24:59.296025 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:24:59.295975 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8qr4f" podStartSLOduration=1.199914557 podStartE2EDuration="2.295959663s" totalImagesPullingTime="1.096045106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:24:59.295465294 +0000 UTC m=+54.762977581" watchObservedRunningTime="2026-09-17 08:24:59.295959663 +0000 UTC m=+54.763471939" Sep 17 08:25:02.290343 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:02.290309 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4" event={"ID":"bdd47568-8625-48a7-976f-2da66bd80738","Type":"ContainerStarted","Data":"76545df3feca097e9080f57ab772ce90cba89fbb59b8f62ffc2d6c5779574952"} Sep 17 08:25:02.305867 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:02.305823 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-z6jr4" podStartSLOduration=1.898397778 podStartE2EDuration="5.30580881s" totalImagesPullingTime="3.407411032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:02.304563589 +0000 UTC m=+57.772075871" watchObservedRunningTime="2026-09-17 08:25:02.30580881 +0000 UTC m=+57.773321133" Sep 17 08:25:04.177212 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.177173 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fqzl6"] Sep 17 08:25:04.203287 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.203252 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fqzl6"] Sep 17 08:25:04.203434 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.203335 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.205930 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.205893 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 08:25:04.205930 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.205893 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 08:25:04.206156 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.206136 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 08:25:04.207024 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.207005 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 08:25:04.207120 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.207025 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-65lfg\"" Sep 17 08:25:04.219958 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.219935 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbwwd" Sep 17 08:25:04.388346 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.388307 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.388518 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.388383 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-crio-socket\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.388518 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.388401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.388518 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.388477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-data-volume\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.388699 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.388545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-498kv\" (UniqueName: \"kubernetes.io/projected/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-api-access-498kv\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.406106 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.406083 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf"] Sep 17 08:25:04.416128 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.416111 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf" Sep 17 08:25:04.417489 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.417469 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf"] Sep 17 08:25:04.418765 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.418744 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 17 08:25:04.418867 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.418771 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 17 08:25:04.418867 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.418849 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cnq9b\"" Sep 17 08:25:04.489452 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.489386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.489452 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.489441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-crio-socket\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.489594 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.489457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.489594 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:04.489509 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 08:25:04.489594 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.489520 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-crio-socket\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.489594 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:04.489559 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 08:25:04.489594 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:04.489578 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:04.989561296 +0000 UTC m=+60.457073571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : configmap "kube-rbac-proxy" not found Sep 17 08:25:04.489801 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:04.489613 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:04.98959946 +0000 UTC m=+60.457111734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : secret "insights-runtime-extractor-tls" not found Sep 17 08:25:04.489801 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.489649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-data-volume\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.489801 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.489673 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-498kv\" (UniqueName: \"kubernetes.io/projected/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-api-access-498kv\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.489903 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.489876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-data-volume\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.498920 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.498903 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-498kv\" (UniqueName: \"kubernetes.io/projected/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-api-access-498kv\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.590494 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.590471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltqv5\" (UniqueName: \"kubernetes.io/projected/83dbc355-a763-4998-b8d7-cdf9c401ac5b-kube-api-access-ltqv5\") pod \"migrator-8b4d697c5-cmsqf\" (UID: \"83dbc355-a763-4998-b8d7-cdf9c401ac5b\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf" Sep 17 08:25:04.690870 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.690840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltqv5\" (UniqueName: \"kubernetes.io/projected/83dbc355-a763-4998-b8d7-cdf9c401ac5b-kube-api-access-ltqv5\") pod \"migrator-8b4d697c5-cmsqf\" (UID: \"83dbc355-a763-4998-b8d7-cdf9c401ac5b\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf" Sep 17 08:25:04.700371 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.700351 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltqv5\" (UniqueName: \"kubernetes.io/projected/83dbc355-a763-4998-b8d7-cdf9c401ac5b-kube-api-access-ltqv5\") pod \"migrator-8b4d697c5-cmsqf\" (UID: \"83dbc355-a763-4998-b8d7-cdf9c401ac5b\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf" Sep 17 08:25:04.726389 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.726369 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf" Sep 17 08:25:04.993233 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.993200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.993385 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:04.993252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:04.993385 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:04.993319 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 08:25:04.993385 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:04.993334 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 08:25:04.993496 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:04.993388 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:05.993370542 +0000 UTC m=+61.460882821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : configmap "kube-rbac-proxy" not found Sep 17 08:25:04.993496 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:04.993409 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:05.993396085 +0000 UTC m=+61.460908346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : secret "insights-runtime-extractor-tls" not found Sep 17 08:25:05.023125 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:05.023066 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf"] Sep 17 08:25:05.026152 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:05.026132 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83dbc355_a763_4998_b8d7_cdf9c401ac5b.slice/crio-dbc46f2c229c4f661a31aa8b9f48b93a5a755bc086369df828404ba66ab7ef81 WatchSource:0}: Error finding container dbc46f2c229c4f661a31aa8b9f48b93a5a755bc086369df828404ba66ab7ef81: Status 404 returned error can't find the container with id dbc46f2c229c4f661a31aa8b9f48b93a5a755bc086369df828404ba66ab7ef81 Sep 17 08:25:05.298501 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:05.298464 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf" event={"ID":"83dbc355-a763-4998-b8d7-cdf9c401ac5b","Type":"ContainerStarted","Data":"dbc46f2c229c4f661a31aa8b9f48b93a5a755bc086369df828404ba66ab7ef81"} Sep 17 08:25:05.937314 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:05.937285 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6dks4_179a10c1-4d7a-4055-aace-6dec464d4097/dns-node-resolver/0.log" Sep 17 08:25:06.001598 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:06.001552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:06.001807 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:06.001770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:06.001868 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:06.001832 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 08:25:06.002547 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:06.002125 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:08.002102529 +0000 UTC m=+63.469614802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : secret "insights-runtime-extractor-tls" not found Sep 17 08:25:06.002547 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:06.001957 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 08:25:06.002547 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:06.002490 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:08.00247018 +0000 UTC m=+63.469982461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : configmap "kube-rbac-proxy" not found Sep 17 08:25:06.937655 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:06.937608 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9r77w_76fa79c8-f383-45bb-8f79-31a592ed0239/node-ca/0.log" Sep 17 08:25:07.305685 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:07.305654 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf" event={"ID":"83dbc355-a763-4998-b8d7-cdf9c401ac5b","Type":"ContainerStarted","Data":"5b42027874df0191729b44b759467559ac5fcab56dcc9ca8291e931725f61464"} Sep 17 08:25:07.305826 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:07.305707 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf" event={"ID":"83dbc355-a763-4998-b8d7-cdf9c401ac5b","Type":"ContainerStarted","Data":"16d88e5f3a95462d9c3361500a9f1b96a68a80047a3635b666e58e5eedef1af9"} Sep 17 08:25:07.325269 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:07.325231 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-cmsqf" podStartSLOduration=1.9593466880000001 podStartE2EDuration="3.325217998s" totalImagesPullingTime="1.36587131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:07.324187084 +0000 UTC m=+62.791699366" watchObservedRunningTime="2026-09-17 08:25:07.325217998 +0000 UTC m=+62.792730279" Sep 17 08:25:07.937915 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:07.937889 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bp954_1e53d483-78b4-4663-bd41-2efdef4ad6fe/serve-healthcheck-canary/0.log" Sep 17 08:25:08.019540 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:08.019516 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:08.019698 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:08.019590 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:08.019698 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:08.019682 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 08:25:08.019698 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:08.019691 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 08:25:08.019805 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:08.019730 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:12.019718255 +0000 UTC m=+67.487230514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : configmap "kube-rbac-proxy" not found Sep 17 08:25:08.019805 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:08.019749 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:12.019737121 +0000 UTC m=+67.487249380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : secret "insights-runtime-extractor-tls" not found Sep 17 08:25:10.741671 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.741611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:25:10.741671 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.741669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:25:10.742190 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:10.741748 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 08:25:10.742190 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:10.741794 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls podName:50a808da-fe8f-434a-be74-e7ac5abaf4fe nodeName:}" failed. No retries permitted until 2026-09-17 08:25:42.741781559 +0000 UTC m=+98.209293818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls") pod "dns-default-dlqhq" (UID: "50a808da-fe8f-434a-be74-e7ac5abaf4fe") : secret "dns-default-metrics-tls" not found Sep 17 08:25:10.742190 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.741786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:25:10.742190 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.741853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:25:10.742190 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:10.741916 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 08:25:10.742190 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:10.741924 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd69d4f5b-mmkh7: secret "image-registry-tls" not found Sep 17 08:25:10.742190 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:10.741949 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls podName:db72abcf-53e6-49be-93dc-2de5d216afb5 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:42.741942613 +0000 UTC m=+98.209454873 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls") pod "image-registry-5fd69d4f5b-mmkh7" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5") : secret "image-registry-tls" not found Sep 17 08:25:10.744319 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.744296 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 08:25:10.744441 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.744422 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 08:25:10.752673 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:10.752653 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 08:25:10.752723 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:10.752709 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs podName:edc69206-7d0f-4086-964c-77facc99d777 nodeName:}" failed. No retries permitted until 2026-09-17 08:26:14.752694484 +0000 UTC m=+130.220206744 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs") pod "network-metrics-daemon-xjrm2" (UID: "edc69206-7d0f-4086-964c-77facc99d777") : secret "metrics-daemon-secret" not found Sep 17 08:25:10.754876 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.754858 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a141cbb6-0bb2-4cc8-b905-5f2cd1f28824-original-pull-secret\") pod \"global-pull-secret-syncer-bn7qh\" (UID: \"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824\") " pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:25:10.943269 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.943238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:25:10.945786 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.945769 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gfw\" (UniqueName: \"kubernetes.io/projected/fd354192-24d2-4e8f-a7f7-f9c0c7c0d839-kube-api-access-b8gfw\") pod \"network-check-target-q4gsh\" (UID: \"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839\") " pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:25:10.961553 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:10.961530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bn7qh" Sep 17 08:25:11.164598 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:11.164570 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gmdck\"" Sep 17 08:25:11.172308 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:11.172286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:25:11.232646 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:11.232604 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bn7qh"] Sep 17 08:25:11.234943 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:11.234916 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda141cbb6_0bb2_4cc8_b905_5f2cd1f28824.slice/crio-9d63f7936404848b2273035d09574d9518efc89f6cf7145ce44be96495cfd6ca WatchSource:0}: Error finding container 9d63f7936404848b2273035d09574d9518efc89f6cf7145ce44be96495cfd6ca: Status 404 returned error can't find the container with id 9d63f7936404848b2273035d09574d9518efc89f6cf7145ce44be96495cfd6ca Sep 17 08:25:11.316976 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:11.316950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bn7qh" event={"ID":"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824","Type":"ContainerStarted","Data":"9d63f7936404848b2273035d09574d9518efc89f6cf7145ce44be96495cfd6ca"} Sep 17 08:25:11.450169 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:11.450139 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q4gsh"] Sep 17 08:25:11.453080 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:11.453056 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd354192_24d2_4e8f_a7f7_f9c0c7c0d839.slice/crio-ae8ffc06e7fcbf381cabf2b5708f91e05b6ac9430e24b58a4b5f936da0c10db8 WatchSource:0}: Error finding container ae8ffc06e7fcbf381cabf2b5708f91e05b6ac9430e24b58a4b5f936da0c10db8: Status 404 returned error can't find the container with id ae8ffc06e7fcbf381cabf2b5708f91e05b6ac9430e24b58a4b5f936da0c10db8 Sep 17 08:25:12.052799 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:12.052768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:12.053181 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:12.052830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:12.053181 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:12.052899 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 08:25:12.053181 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:12.052917 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 08:25:12.053181 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:12.052958 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:20.052944092 +0000 UTC m=+75.520456355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : configmap "kube-rbac-proxy" not found Sep 17 08:25:12.053181 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:12.052971 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:20.052965307 +0000 UTC m=+75.520477568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : secret "insights-runtime-extractor-tls" not found Sep 17 08:25:12.321641 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:12.321547 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q4gsh" event={"ID":"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839","Type":"ContainerStarted","Data":"b2415dc80a56f5263b1ef89f9c22cb47d22e113be4f7d259f575703b53f84ee9"} Sep 17 08:25:12.321641 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:12.321596 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q4gsh" event={"ID":"fd354192-24d2-4e8f-a7f7-f9c0c7c0d839","Type":"ContainerStarted","Data":"ae8ffc06e7fcbf381cabf2b5708f91e05b6ac9430e24b58a4b5f936da0c10db8"} Sep 17 08:25:12.321807 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:12.321685 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:25:12.344097 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:12.344055 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q4gsh" podStartSLOduration=67.344042605 podStartE2EDuration="1m7.344042605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:12.342718925 +0000 UTC m=+67.810231207" watchObservedRunningTime="2026-09-17 08:25:12.344042605 +0000 UTC m=+67.811554924" Sep 17 08:25:16.339055 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:16.339016 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bn7qh" event={"ID":"a141cbb6-0bb2-4cc8-b905-5f2cd1f28824","Type":"ContainerStarted","Data":"07101569c0ac50cf711da0cd0c8440f4f718e6229457690d421ac0948fff37a4"} Sep 17 08:25:16.355088 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:16.355033 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bn7qh" podStartSLOduration=66.595217821 podStartE2EDuration="1m11.355018571s" totalImagesPullingTime="4.75980075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:16.353690753 +0000 UTC m=+71.821203035" watchObservedRunningTime="2026-09-17 08:25:16.355018571 +0000 UTC m=+71.822530853" Sep 17 08:25:20.119246 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:20.119195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:20.119672 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:20.119282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:20.119672 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:20.119420 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 08:25:20.119672 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:20.119485 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls podName:cc9417f1-af51-495e-acb4-cb4f04d6bcc3 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:36.119469565 +0000 UTC m=+91.586981825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqzl6" (UID: "cc9417f1-af51-495e-acb4-cb4f04d6bcc3") : secret "insights-runtime-extractor-tls" not found Sep 17 08:25:20.119807 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:20.119768 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:30.838705 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.838582 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr"] Sep 17 08:25:30.844143 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.844119 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:30.847502 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.847477 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 17 08:25:30.847502 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.847499 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 08:25:30.847708 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.847532 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 08:25:30.847708 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.847553 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 08:25:30.852459 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.852437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr"] Sep 17 08:25:30.869029 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.869008 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-6kpmz"] Sep 17 08:25:30.872997 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.872978 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-6kpmz" Sep 17 08:25:30.875314 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.875293 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 08:25:30.876987 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.876973 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 08:25:30.877050 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.877001 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4qw8k\"" Sep 17 08:25:30.887260 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.887234 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-6kpmz"] Sep 17 08:25:30.894187 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.894166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ad133993-998a-4594-8f29-a92a9cc65cc4-klusterlet-config\") pod \"klusterlet-addon-workmgr-6599ccdcd5-gkdmr\" (UID: \"ad133993-998a-4594-8f29-a92a9cc65cc4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:30.894274 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.894229 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad133993-998a-4594-8f29-a92a9cc65cc4-tmp\") pod \"klusterlet-addon-workmgr-6599ccdcd5-gkdmr\" (UID: \"ad133993-998a-4594-8f29-a92a9cc65cc4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:30.894316 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.894270 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xckzc\" (UniqueName: \"kubernetes.io/projected/ad133993-998a-4594-8f29-a92a9cc65cc4-kube-api-access-xckzc\") pod \"klusterlet-addon-workmgr-6599ccdcd5-gkdmr\" (UID: \"ad133993-998a-4594-8f29-a92a9cc65cc4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:30.995582 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.995547 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnv6h\" (UniqueName: \"kubernetes.io/projected/0b3cb928-4e76-4ce2-9406-f25102090879-kube-api-access-tnv6h\") pod \"downloads-76f99584f4-6kpmz\" (UID: \"0b3cb928-4e76-4ce2-9406-f25102090879\") " pod="openshift-console/downloads-76f99584f4-6kpmz" Sep 17 08:25:30.995758 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.995592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ad133993-998a-4594-8f29-a92a9cc65cc4-klusterlet-config\") pod \"klusterlet-addon-workmgr-6599ccdcd5-gkdmr\" (UID: \"ad133993-998a-4594-8f29-a92a9cc65cc4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:30.995758 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.995706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad133993-998a-4594-8f29-a92a9cc65cc4-tmp\") pod \"klusterlet-addon-workmgr-6599ccdcd5-gkdmr\" (UID: \"ad133993-998a-4594-8f29-a92a9cc65cc4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:30.995758 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.995752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xckzc\" (UniqueName: \"kubernetes.io/projected/ad133993-998a-4594-8f29-a92a9cc65cc4-kube-api-access-xckzc\") pod \"klusterlet-addon-workmgr-6599ccdcd5-gkdmr\" (UID: \"ad133993-998a-4594-8f29-a92a9cc65cc4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:30.996101 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.996082 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad133993-998a-4594-8f29-a92a9cc65cc4-tmp\") pod \"klusterlet-addon-workmgr-6599ccdcd5-gkdmr\" (UID: \"ad133993-998a-4594-8f29-a92a9cc65cc4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:30.998295 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:30.998267 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ad133993-998a-4594-8f29-a92a9cc65cc4-klusterlet-config\") pod \"klusterlet-addon-workmgr-6599ccdcd5-gkdmr\" (UID: \"ad133993-998a-4594-8f29-a92a9cc65cc4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:31.006443 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:31.006421 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xckzc\" (UniqueName: \"kubernetes.io/projected/ad133993-998a-4594-8f29-a92a9cc65cc4-kube-api-access-xckzc\") pod \"klusterlet-addon-workmgr-6599ccdcd5-gkdmr\" (UID: \"ad133993-998a-4594-8f29-a92a9cc65cc4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:31.096346 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:31.096264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnv6h\" (UniqueName: \"kubernetes.io/projected/0b3cb928-4e76-4ce2-9406-f25102090879-kube-api-access-tnv6h\") pod \"downloads-76f99584f4-6kpmz\" (UID: \"0b3cb928-4e76-4ce2-9406-f25102090879\") " pod="openshift-console/downloads-76f99584f4-6kpmz" Sep 17 08:25:31.111332 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:31.111304 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnv6h\" (UniqueName: \"kubernetes.io/projected/0b3cb928-4e76-4ce2-9406-f25102090879-kube-api-access-tnv6h\") pod \"downloads-76f99584f4-6kpmz\" (UID: \"0b3cb928-4e76-4ce2-9406-f25102090879\") " pod="openshift-console/downloads-76f99584f4-6kpmz" Sep 17 08:25:31.153560 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:31.153532 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:31.181514 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:31.181488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-6kpmz" Sep 17 08:25:31.426942 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:31.424845 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr"] Sep 17 08:25:31.430776 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:31.430749 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad133993_998a_4594_8f29_a92a9cc65cc4.slice/crio-60acfd417375b8bce6d9f4d509aa331cd74ad8a33a1b277ea9a689ffa5bf6c0f WatchSource:0}: Error finding container 60acfd417375b8bce6d9f4d509aa331cd74ad8a33a1b277ea9a689ffa5bf6c0f: Status 404 returned error can't find the container with id 60acfd417375b8bce6d9f4d509aa331cd74ad8a33a1b277ea9a689ffa5bf6c0f Sep 17 08:25:31.473048 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:31.473012 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-6kpmz"] Sep 17 08:25:31.477154 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:31.477129 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3cb928_4e76_4ce2_9406_f25102090879.slice/crio-4a18e544b6a1e7d72055e451548805379a86ad8878dc08043b289ea6c0c83920 WatchSource:0}: Error finding container 4a18e544b6a1e7d72055e451548805379a86ad8878dc08043b289ea6c0c83920: Status 404 returned error can't find the container with id 4a18e544b6a1e7d72055e451548805379a86ad8878dc08043b289ea6c0c83920 Sep 17 08:25:32.325502 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.325439 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz"] Sep 17 08:25:32.328771 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.328749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" Sep 17 08:25:32.331456 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.331433 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 08:25:32.332669 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.332645 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-frjjg\"" Sep 17 08:25:32.338825 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.338805 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz"] Sep 17 08:25:32.387574 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.387542 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" event={"ID":"ad133993-998a-4594-8f29-a92a9cc65cc4","Type":"ContainerStarted","Data":"60acfd417375b8bce6d9f4d509aa331cd74ad8a33a1b277ea9a689ffa5bf6c0f"} Sep 17 08:25:32.389139 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.389086 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-6kpmz" event={"ID":"0b3cb928-4e76-4ce2-9406-f25102090879","Type":"ContainerStarted","Data":"4a18e544b6a1e7d72055e451548805379a86ad8878dc08043b289ea6c0c83920"} Sep 17 08:25:32.407697 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.407602 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/39b52a79-b6b6-4378-9a4c-08dfc6d0f7d4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-nvkbz\" (UID: \"39b52a79-b6b6-4378-9a4c-08dfc6d0f7d4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" Sep 17 08:25:32.508237 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.508061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/39b52a79-b6b6-4378-9a4c-08dfc6d0f7d4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-nvkbz\" (UID: \"39b52a79-b6b6-4378-9a4c-08dfc6d0f7d4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" Sep 17 08:25:32.513737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.513704 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/39b52a79-b6b6-4378-9a4c-08dfc6d0f7d4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-nvkbz\" (UID: \"39b52a79-b6b6-4378-9a4c-08dfc6d0f7d4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" Sep 17 08:25:32.641686 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.641589 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" Sep 17 08:25:32.938710 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:32.938605 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz"] Sep 17 08:25:32.944302 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:32.943966 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b52a79_b6b6_4378_9a4c_08dfc6d0f7d4.slice/crio-2f0d5db09607cde5dcc6cbee9164e43ce9051dd759a506eb1773035a89f750a6 WatchSource:0}: Error finding container 2f0d5db09607cde5dcc6cbee9164e43ce9051dd759a506eb1773035a89f750a6: Status 404 returned error can't find the container with id 2f0d5db09607cde5dcc6cbee9164e43ce9051dd759a506eb1773035a89f750a6 Sep 17 08:25:33.396495 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:33.396452 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" event={"ID":"39b52a79-b6b6-4378-9a4c-08dfc6d0f7d4","Type":"ContainerStarted","Data":"2f0d5db09607cde5dcc6cbee9164e43ce9051dd759a506eb1773035a89f750a6"} Sep 17 08:25:36.140163 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.140125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:36.143729 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.143305 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc9417f1-af51-495e-acb4-cb4f04d6bcc3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqzl6\" (UID: \"cc9417f1-af51-495e-acb4-cb4f04d6bcc3\") " pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:36.316072 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.316040 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-65lfg\"" Sep 17 08:25:36.324189 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.324163 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fqzl6" Sep 17 08:25:36.412362 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.412233 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" event={"ID":"ad133993-998a-4594-8f29-a92a9cc65cc4","Type":"ContainerStarted","Data":"31ea01aab3eb32f65fcee40a4290506db87a65e5d518d2b7d2aed89bb5ccfd3f"} Sep 17 08:25:36.413825 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.413780 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:36.414550 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.414530 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" Sep 17 08:25:36.415687 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.415659 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" event={"ID":"39b52a79-b6b6-4378-9a4c-08dfc6d0f7d4","Type":"ContainerStarted","Data":"5bb4a6e7a9394bde813e6eec32d647097d48efe86a7a10f3a67755306c86ba22"} Sep 17 08:25:36.416015 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.415997 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" Sep 17 08:25:36.421243 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.421221 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" Sep 17 08:25:36.450772 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.450705 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6599ccdcd5-gkdmr" podStartSLOduration=1.822384699 podStartE2EDuration="6.450686139s" totalImagesPullingTime="4.62830144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:36.432146962 +0000 UTC m=+91.899659245" watchObservedRunningTime="2026-09-17 08:25:36.450686139 +0000 UTC m=+91.918198423" Sep 17 08:25:36.465162 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.465115 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-nvkbz" podStartSLOduration=1.368184952 podStartE2EDuration="4.465099309s" totalImagesPullingTime="3.096914357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:36.464102356 +0000 UTC m=+91.931614639" watchObservedRunningTime="2026-09-17 08:25:36.465099309 +0000 UTC m=+91.932611592" Sep 17 08:25:36.604005 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:36.603926 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fqzl6"] Sep 17 08:25:36.606484 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:36.606460 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9417f1_af51_495e_acb4_cb4f04d6bcc3.slice/crio-26be4ecdd4a9dde84e87fc747b9c337919e44a16d2c051e8fa813270d558d91d WatchSource:0}: Error finding container 26be4ecdd4a9dde84e87fc747b9c337919e44a16d2c051e8fa813270d558d91d: Status 404 returned error can't find the container with id 26be4ecdd4a9dde84e87fc747b9c337919e44a16d2c051e8fa813270d558d91d Sep 17 08:25:37.420913 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.420874 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqzl6" event={"ID":"cc9417f1-af51-495e-acb4-cb4f04d6bcc3","Type":"ContainerStarted","Data":"3d090a1c59891745f26701201ee0694ed9a274076857335b5b83899850cea93f"} Sep 17 08:25:37.421343 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.420958 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqzl6" event={"ID":"cc9417f1-af51-495e-acb4-cb4f04d6bcc3","Type":"ContainerStarted","Data":"26be4ecdd4a9dde84e87fc747b9c337919e44a16d2c051e8fa813270d558d91d"} Sep 17 08:25:37.502009 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.501982 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5974c87cf7-2hbqq"] Sep 17 08:25:37.505290 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.505271 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.507931 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.507908 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4q2p6\"" Sep 17 08:25:37.508036 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.507931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 08:25:37.508180 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.508159 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 08:25:37.508275 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.508193 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 08:25:37.508434 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.508419 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 08:25:37.508517 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.508432 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 08:25:37.517810 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.517790 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5974c87cf7-2hbqq"] Sep 17 08:25:37.553160 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.553133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-serving-cert\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.553309 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.553281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-oauth-serving-cert\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.553397 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.553379 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-console-config\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.553455 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.553436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9bvv\" (UniqueName: \"kubernetes.io/projected/2ab49c52-01de-4e60-a34d-4452304e443e-kube-api-access-f9bvv\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.553513 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.553493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-service-ca\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.553570 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.553525 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-oauth-config\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.654600 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.654569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-oauth-serving-cert\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.654790 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.654666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-console-config\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.654790 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.654690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9bvv\" (UniqueName: \"kubernetes.io/projected/2ab49c52-01de-4e60-a34d-4452304e443e-kube-api-access-f9bvv\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.654790 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.654715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-service-ca\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.654790 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.654746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-oauth-config\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.654790 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.654781 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-serving-cert\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.655440 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.655411 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-oauth-serving-cert\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.655539 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.655420 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-console-config\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.655790 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.655572 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-service-ca\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.657741 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.657707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-oauth-config\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.657865 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.657803 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-serving-cert\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.663271 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.663246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9bvv\" (UniqueName: \"kubernetes.io/projected/2ab49c52-01de-4e60-a34d-4452304e443e-kube-api-access-f9bvv\") pod \"console-5974c87cf7-2hbqq\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:37.817507 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:37.817443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:38.097508 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:38.097471 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5974c87cf7-2hbqq"] Sep 17 08:25:38.100057 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:38.100023 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab49c52_01de_4e60_a34d_4452304e443e.slice/crio-9d193340e16879d2175b7fd39dd150d6571b51959654075affa1fa5737d2cb75 WatchSource:0}: Error finding container 9d193340e16879d2175b7fd39dd150d6571b51959654075affa1fa5737d2cb75: Status 404 returned error can't find the container with id 9d193340e16879d2175b7fd39dd150d6571b51959654075affa1fa5737d2cb75 Sep 17 08:25:38.427058 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:38.426925 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqzl6" event={"ID":"cc9417f1-af51-495e-acb4-cb4f04d6bcc3","Type":"ContainerStarted","Data":"3a0201be77961485bc876ea17ac4e3f333f977c3cb9ea4b576c8d28cacd419cd"} Sep 17 08:25:38.428867 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:38.428784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5974c87cf7-2hbqq" event={"ID":"2ab49c52-01de-4e60-a34d-4452304e443e","Type":"ContainerStarted","Data":"9d193340e16879d2175b7fd39dd150d6571b51959654075affa1fa5737d2cb75"} Sep 17 08:25:39.436260 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:39.436219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqzl6" event={"ID":"cc9417f1-af51-495e-acb4-cb4f04d6bcc3","Type":"ContainerStarted","Data":"5ca48e9756fa698067bdfb837ad8a6853bdc54e37f499dff501c18ef2bf451a6"} Sep 17 08:25:39.454675 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:39.454576 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fqzl6" podStartSLOduration=32.965189776 podStartE2EDuration="35.454556184s" totalImagesPullingTime="2.489366408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:25:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:39.452832821 +0000 UTC m=+94.920345104" watchObservedRunningTime="2026-09-17 08:25:39.454556184 +0000 UTC m=+94.922068467" Sep 17 08:25:41.743346 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.743256 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q"] Sep 17 08:25:41.746705 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.746682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.749909 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.749354 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 08:25:41.749909 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.749444 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 08:25:41.749909 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.749705 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 08:25:41.749909 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.749737 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 08:25:41.750490 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.750468 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 08:25:41.750593 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.750504 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2vzlm\"" Sep 17 08:25:41.758048 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.758028 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q"] Sep 17 08:25:41.766010 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.765991 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn"] Sep 17 08:25:41.768988 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.768972 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.771966 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.771943 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 08:25:41.772165 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.772142 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 08:25:41.772697 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.772678 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 08:25:41.772697 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.772694 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9fhq6\"" Sep 17 08:25:41.788230 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.788205 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn"] Sep 17 08:25:41.790203 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.790182 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6v95x"] Sep 17 08:25:41.793782 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.793761 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.796658 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.796514 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 08:25:41.796658 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.796550 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q9qzs\"" Sep 17 08:25:41.796989 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.796885 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 08:25:41.796989 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.796942 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 08:25:41.887021 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.886985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8789481a-50e3-47d6-8f93-2689fbb7b6f0-metrics-client-ca\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.887187 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.887187 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-textfile\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.887187 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887159 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-wtmp\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.887315 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.887315 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8789481a-50e3-47d6-8f93-2689fbb7b6f0-sys\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.887315 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/34e5fd67-3cda-4873-85e7-4df55bae9e4e-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.887315 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887282 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.887315 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhtcw\" (UniqueName: \"kubernetes.io/projected/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-kube-api-access-fhtcw\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.887503 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-tls\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.887503 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.887503 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887465 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.887609 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl8qw\" (UniqueName: \"kubernetes.io/projected/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-api-access-dl8qw\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.887609 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8789481a-50e3-47d6-8f93-2689fbb7b6f0-root\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.887609 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.887609 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887581 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e5fd67-3cda-4873-85e7-4df55bae9e4e-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.887788 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xqz7\" (UniqueName: \"kubernetes.io/projected/8789481a-50e3-47d6-8f93-2689fbb7b6f0-kube-api-access-4xqz7\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.887788 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.887788 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.887690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.988714 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8789481a-50e3-47d6-8f93-2689fbb7b6f0-metrics-client-ca\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.988892 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.988892 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-textfile\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.988892 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-wtmp\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.988892 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.988892 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8789481a-50e3-47d6-8f93-2689fbb7b6f0-sys\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.988892 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/34e5fd67-3cda-4873-85e7-4df55bae9e4e-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.988892 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhtcw\" (UniqueName: \"kubernetes.io/projected/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-kube-api-access-fhtcw\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-tls\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.988969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989045 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl8qw\" (UniqueName: \"kubernetes.io/projected/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-api-access-dl8qw\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8789481a-50e3-47d6-8f93-2689fbb7b6f0-root\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e5fd67-3cda-4873-85e7-4df55bae9e4e-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xqz7\" (UniqueName: \"kubernetes.io/projected/8789481a-50e3-47d6-8f93-2689fbb7b6f0-kube-api-access-4xqz7\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-textfile\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989226 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.989828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989362 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8789481a-50e3-47d6-8f93-2689fbb7b6f0-sys\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989828 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:41.989391 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 08:25:41.989828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989417 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8789481a-50e3-47d6-8f93-2689fbb7b6f0-metrics-client-ca\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989828 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:25:41.989455 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-tls podName:8789481a-50e3-47d6-8f93-2689fbb7b6f0 nodeName:}" failed. No retries permitted until 2026-09-17 08:25:42.489434685 +0000 UTC m=+97.956947167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-tls") pod "node-exporter-6v95x" (UID: "8789481a-50e3-47d6-8f93-2689fbb7b6f0") : secret "node-exporter-tls" not found Sep 17 08:25:41.989828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989476 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.989828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989502 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-wtmp\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8789481a-50e3-47d6-8f93-2689fbb7b6f0-root\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989716 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:41.989828 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.989791 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/34e5fd67-3cda-4873-85e7-4df55bae9e4e-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.990557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.990534 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.990665 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.990551 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e5fd67-3cda-4873-85e7-4df55bae9e4e-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.992476 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.992453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.992681 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.992661 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:41.992765 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.992678 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.992823 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.992786 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:41.992997 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:41.992978 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:42.002286 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.002235 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhtcw\" (UniqueName: \"kubernetes.io/projected/277fe07c-d1ca-4c36-b0e3-e929d06cb6a5-kube-api-access-fhtcw\") pod \"openshift-state-metrics-67dcf8c979-jpv9q\" (UID: \"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:42.002392 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.002360 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xqz7\" (UniqueName: \"kubernetes.io/projected/8789481a-50e3-47d6-8f93-2689fbb7b6f0-kube-api-access-4xqz7\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:42.002473 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.002450 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl8qw\" (UniqueName: \"kubernetes.io/projected/34e5fd67-3cda-4873-85e7-4df55bae9e4e-kube-api-access-dl8qw\") pod \"kube-state-metrics-59fbdd77d-6qxqn\" (UID: \"34e5fd67-3cda-4873-85e7-4df55bae9e4e\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:42.058012 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.057974 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" Sep 17 08:25:42.078695 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.078671 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" Sep 17 08:25:42.452583 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.452539 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5974c87cf7-2hbqq" event={"ID":"2ab49c52-01de-4e60-a34d-4452304e443e","Type":"ContainerStarted","Data":"8e7b0839be54a8eda16439a150e0a748a060c568d0489be3ab8a78ec1c6f434b"} Sep 17 08:25:42.476004 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.475947 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5974c87cf7-2hbqq" podStartSLOduration=2.197299679 podStartE2EDuration="5.475929901s" totalImagesPullingTime="3.278630222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:42.474601157 +0000 UTC m=+97.942113441" watchObservedRunningTime="2026-09-17 08:25:42.475929901 +0000 UTC m=+97.943442184" Sep 17 08:25:42.492884 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.492849 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-tls\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:42.495775 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.495754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8789481a-50e3-47d6-8f93-2689fbb7b6f0-node-exporter-tls\") pod \"node-exporter-6v95x\" (UID: \"8789481a-50e3-47d6-8f93-2689fbb7b6f0\") " pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:42.705745 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.705675 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6v95x" Sep 17 08:25:42.795673 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.795613 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:25:42.796120 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.795692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:25:42.798386 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.798361 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"image-registry-5fd69d4f5b-mmkh7\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:25:42.798509 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.798362 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50a808da-fe8f-434a-be74-e7ac5abaf4fe-metrics-tls\") pod \"dns-default-dlqhq\" (UID: \"50a808da-fe8f-434a-be74-e7ac5abaf4fe\") " pod="openshift-dns/dns-default-dlqhq" Sep 17 08:25:42.803062 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.803039 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m5gxp\"" Sep 17 08:25:42.810713 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.810688 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:25:42.818989 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.818968 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdz5j\"" Sep 17 08:25:42.827146 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.827129 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlqhq" Sep 17 08:25:42.854982 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.854952 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 08:25:42.859310 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.859289 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.863037 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.862999 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 08:25:42.863319 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.863298 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 08:25:42.863421 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.863373 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 08:25:42.863482 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.863462 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 08:25:42.863978 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.863956 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wx68j\"" Sep 17 08:25:42.864266 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.864244 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 08:25:42.864355 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.864327 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 08:25:42.864418 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.864243 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 08:25:42.864658 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.864643 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 08:25:42.864985 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.864743 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 08:25:42.881286 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.881261 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 08:25:42.997650 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.997553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-web-config\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.997650 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.997600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.997841 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.997709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-out\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.997841 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.997752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.997841 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.997826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.997990 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.997867 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.997990 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.997898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk7cg\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-kube-api-access-lk7cg\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.997990 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.997925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.998123 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.997993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.998123 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.998038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.998123 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.998061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.998123 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.998095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:42.998123 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:42.998115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.098898 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.098858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.099084 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.098903 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.099084 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.098941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk7cg\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-kube-api-access-lk7cg\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.099084 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.098970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.099255 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.099168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.099255 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.099210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.099255 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.099238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.099404 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.099274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.099404 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.099307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.100755 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.099336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-web-config\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.100755 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.099571 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.100755 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.099765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-out\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.100755 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.099855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.100755 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.100076 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.101641 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.101418 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.101641 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.101576 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.102077 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.102056 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.102391 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.102364 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.102771 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.102746 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.103925 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.103887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.104259 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.104184 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-web-config\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.104424 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.104405 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-out\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.104690 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.104667 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.104797 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.104758 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.106212 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.106187 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.115373 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.115349 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk7cg\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-kube-api-access-lk7cg\") pod \"alertmanager-main-0\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.171319 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.171285 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:25:43.328499 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:43.328473 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q4gsh" Sep 17 08:25:46.175840 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.175802 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-99b4cdcbf-hscx4"] Sep 17 08:25:46.179609 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.179578 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.183153 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.183122 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 08:25:46.183291 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.183133 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bhvbt\"" Sep 17 08:25:46.183291 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.183135 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 08:25:46.183291 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.183209 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 08:25:46.183291 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.183241 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-agr7p4bev5dpm\"" Sep 17 08:25:46.183500 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.183404 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 08:25:46.193578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.193339 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-99b4cdcbf-hscx4"] Sep 17 08:25:46.329122 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.329086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/922ed2eb-6779-424c-94e3-6160667139be-audit-log\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.329278 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.329133 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nspt\" (UniqueName: \"kubernetes.io/projected/922ed2eb-6779-424c-94e3-6160667139be-kube-api-access-8nspt\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.329339 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.329284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/922ed2eb-6779-424c-94e3-6160667139be-secret-metrics-server-tls\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.329339 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.329328 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/922ed2eb-6779-424c-94e3-6160667139be-secret-metrics-server-client-certs\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.329429 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.329407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922ed2eb-6779-424c-94e3-6160667139be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.329489 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.329458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/922ed2eb-6779-424c-94e3-6160667139be-client-ca-bundle\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.329571 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.329554 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/922ed2eb-6779-424c-94e3-6160667139be-metrics-server-audit-profiles\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.430526 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.430441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/922ed2eb-6779-424c-94e3-6160667139be-secret-metrics-server-tls\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.430526 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.430488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/922ed2eb-6779-424c-94e3-6160667139be-secret-metrics-server-client-certs\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.430526 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.430525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922ed2eb-6779-424c-94e3-6160667139be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.430830 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.430544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/922ed2eb-6779-424c-94e3-6160667139be-client-ca-bundle\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.430830 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.430601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/922ed2eb-6779-424c-94e3-6160667139be-metrics-server-audit-profiles\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.430830 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.430649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/922ed2eb-6779-424c-94e3-6160667139be-audit-log\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.430830 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.430666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nspt\" (UniqueName: \"kubernetes.io/projected/922ed2eb-6779-424c-94e3-6160667139be-kube-api-access-8nspt\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.431747 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.431721 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/922ed2eb-6779-424c-94e3-6160667139be-audit-log\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.432080 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.432058 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922ed2eb-6779-424c-94e3-6160667139be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.432183 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.432156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/922ed2eb-6779-424c-94e3-6160667139be-metrics-server-audit-profiles\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.433502 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.433468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/922ed2eb-6779-424c-94e3-6160667139be-secret-metrics-server-client-certs\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.433832 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.433813 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/922ed2eb-6779-424c-94e3-6160667139be-client-ca-bundle\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.433934 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.433869 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/922ed2eb-6779-424c-94e3-6160667139be-secret-metrics-server-tls\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.440976 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.440949 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nspt\" (UniqueName: \"kubernetes.io/projected/922ed2eb-6779-424c-94e3-6160667139be-kube-api-access-8nspt\") pod \"metrics-server-99b4cdcbf-hscx4\" (UID: \"922ed2eb-6779-424c-94e3-6160667139be\") " pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:46.491568 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:46.491529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:25:47.510777 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.510746 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5974c87cf7-2hbqq"] Sep 17 08:25:47.549003 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.548976 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fbc7df9dd-mdt4l"] Sep 17 08:25:47.567791 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.567762 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbc7df9dd-mdt4l"] Sep 17 08:25:47.567953 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.567872 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.582042 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.582013 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 08:25:47.643014 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.642970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-serving-cert\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.643171 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.643033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-oauth-config\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.643171 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.643127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-trusted-ca-bundle\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.643268 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.643175 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-service-ca\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.643305 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.643275 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-oauth-serving-cert\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.643369 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.643307 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsgd8\" (UniqueName: \"kubernetes.io/projected/902a3dd7-2ce4-4359-9854-1b42645c6ef5-kube-api-access-lsgd8\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.643369 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.643332 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-config\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.743864 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.743831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-oauth-serving-cert\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.744005 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.743871 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsgd8\" (UniqueName: \"kubernetes.io/projected/902a3dd7-2ce4-4359-9854-1b42645c6ef5-kube-api-access-lsgd8\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.744005 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.743895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-config\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.744005 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.743929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-serving-cert\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.744005 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.743970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-oauth-config\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.744005 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.744003 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-trusted-ca-bundle\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.744220 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.744027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-service-ca\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.744696 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.744636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-oauth-serving-cert\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.744820 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.744752 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-service-ca\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.745296 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.745249 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-config\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.745578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.745554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-trusted-ca-bundle\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.746999 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.746979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-serving-cert\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.747098 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.747051 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-oauth-config\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.751760 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.751742 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsgd8\" (UniqueName: \"kubernetes.io/projected/902a3dd7-2ce4-4359-9854-1b42645c6ef5-kube-api-access-lsgd8\") pod \"console-6fbc7df9dd-mdt4l\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:47.817752 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.817715 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:25:47.881741 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:47.881652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:48.033770 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.033735 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 08:25:48.056169 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.056141 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.062233 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.062202 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 08:25:48.062376 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.062358 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 08:25:48.062595 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.062534 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mrppk\"" Sep 17 08:25:48.062595 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.062559 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 08:25:48.062783 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.062688 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fe8v62llqdcev\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.062833 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.062930 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.062944 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.063088 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.063237 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.063370 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.063483 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.063726 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.063742 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.064108 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 08:25:48.065240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.065204 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 08:25:48.065936 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.065719 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 08:25:48.147098 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147098 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147098 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147360 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147112 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147360 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147360 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147360 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147360 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147556 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147556 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d5fd\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-kube-api-access-5d5fd\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147556 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147556 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147556 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147556 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147839 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147839 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147653 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147839 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147839 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147839 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.147839 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.147829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.248613 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.248815 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248667 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.248815 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.248815 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.248815 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.248815 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249043 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249043 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249043 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249043 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249043 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248959 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249043 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.248982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d5fd\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-kube-api-access-5d5fd\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249043 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.249017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249339 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.249043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249339 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.249070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249339 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.249103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249339 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.249128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249339 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.249167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249339 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.249192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249339 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.249226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.249717 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.249688 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.250404 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.250377 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.250889 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.250861 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.251125 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.251100 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.251448 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.251424 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.251929 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.251865 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.252088 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.252066 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.252088 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.252076 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.254777 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.254753 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.255204 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.255176 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.255204 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.255239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-web-config\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.255204 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.255244 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config-out\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.255566 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.255355 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.255566 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.255462 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.255882 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.255861 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.256700 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.256679 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.257420 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.257397 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.257821 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.257797 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.258439 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.258409 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.261066 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.261043 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d5fd\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-kube-api-access-5d5fd\") pod \"prometheus-k8s-0\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:48.368436 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:48.368390 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:25:49.146916 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.146859 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 08:25:49.149090 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:49.149054 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9435b6f4_c770_43a2_a169_a73346dcf5b7.slice/crio-d2c887d7a12e769181bf0e114b6e495f00fdf1ee8576e23c0b1f9e259678657d WatchSource:0}: Error finding container d2c887d7a12e769181bf0e114b6e495f00fdf1ee8576e23c0b1f9e259678657d: Status 404 returned error can't find the container with id d2c887d7a12e769181bf0e114b6e495f00fdf1ee8576e23c0b1f9e259678657d Sep 17 08:25:49.195186 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.195151 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-99b4cdcbf-hscx4"] Sep 17 08:25:49.200331 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:49.199467 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922ed2eb_6779_424c_94e3_6160667139be.slice/crio-8c5bac6849d654294d164b749b4c36fa8ea5633afaf6d1095920c57511d23a2a WatchSource:0}: Error finding container 8c5bac6849d654294d164b749b4c36fa8ea5633afaf6d1095920c57511d23a2a: Status 404 returned error can't find the container with id 8c5bac6849d654294d164b749b4c36fa8ea5633afaf6d1095920c57511d23a2a Sep 17 08:25:49.213690 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.213660 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q"] Sep 17 08:25:49.217004 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.216907 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd69d4f5b-mmkh7"] Sep 17 08:25:49.221737 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.221713 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 08:25:49.222613 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:49.222262 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb72abcf_53e6_49be_93dc_2de5d216afb5.slice/crio-4c1e90311c0a16da58b57cfd0f75e3da177282777459a50db016460244a0db45 WatchSource:0}: Error finding container 4c1e90311c0a16da58b57cfd0f75e3da177282777459a50db016460244a0db45: Status 404 returned error can't find the container with id 4c1e90311c0a16da58b57cfd0f75e3da177282777459a50db016460244a0db45 Sep 17 08:25:49.225959 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:49.225935 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3076f5_4f16_4a0c_8666_e8bfedd3530b.slice/crio-0d3e6d6bc1153bbdbb1801f3e366e9eb97d8c6460d1b1ee7779c57ff5fb73540 WatchSource:0}: Error finding container 0d3e6d6bc1153bbdbb1801f3e366e9eb97d8c6460d1b1ee7779c57ff5fb73540: Status 404 returned error can't find the container with id 0d3e6d6bc1153bbdbb1801f3e366e9eb97d8c6460d1b1ee7779c57ff5fb73540 Sep 17 08:25:49.240674 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.240568 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbc7df9dd-mdt4l"] Sep 17 08:25:49.264299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.264251 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dlqhq"] Sep 17 08:25:49.267838 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.267815 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn"] Sep 17 08:25:49.271546 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:25:49.271500 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a808da_fe8f_434a_be74_e7ac5abaf4fe.slice/crio-a0c1f01bf53ff3f646dcb3a15527897b93c92789acd7f56820b6b251babeb770 WatchSource:0}: Error finding container a0c1f01bf53ff3f646dcb3a15527897b93c92789acd7f56820b6b251babeb770: Status 404 returned error can't find the container with id a0c1f01bf53ff3f646dcb3a15527897b93c92789acd7f56820b6b251babeb770 Sep 17 08:25:49.486036 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.485990 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" event={"ID":"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5","Type":"ContainerStarted","Data":"3be03a710ff6d3b2a36b80f94b38b1945a45d185d3e55bfd42c8ee40d7a34e19"} Sep 17 08:25:49.486209 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.486107 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" event={"ID":"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5","Type":"ContainerStarted","Data":"7af3aee0c5097d9bf2d41f1ebc1d9a772532d8a425c555ad2f2ac9d979a26420"} Sep 17 08:25:49.486209 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.486140 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" event={"ID":"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5","Type":"ContainerStarted","Data":"d68a448b3ba604cdf54a7abfbd77604a454584e700df9cc6d97c791ccc698399"} Sep 17 08:25:49.488676 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.488562 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerStarted","Data":"d2c887d7a12e769181bf0e114b6e495f00fdf1ee8576e23c0b1f9e259678657d"} Sep 17 08:25:49.490422 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.490350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dlqhq" event={"ID":"50a808da-fe8f-434a-be74-e7ac5abaf4fe","Type":"ContainerStarted","Data":"a0c1f01bf53ff3f646dcb3a15527897b93c92789acd7f56820b6b251babeb770"} Sep 17 08:25:49.493097 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.493019 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6v95x" event={"ID":"8789481a-50e3-47d6-8f93-2689fbb7b6f0","Type":"ContainerStarted","Data":"e928cad14844add0f99ac8581e53f634a4b74533f7778fd0698de8f38a1b2b52"} Sep 17 08:25:49.495237 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.495163 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" event={"ID":"922ed2eb-6779-424c-94e3-6160667139be","Type":"ContainerStarted","Data":"8c5bac6849d654294d164b749b4c36fa8ea5633afaf6d1095920c57511d23a2a"} Sep 17 08:25:49.499594 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.499536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-6kpmz" event={"ID":"0b3cb928-4e76-4ce2-9406-f25102090879","Type":"ContainerStarted","Data":"c412b07c1f63ce6d0489dc20615e7a2e20ed872c2aeb1ecd56540dd86a3e62ec"} Sep 17 08:25:49.499798 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.499751 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-6kpmz" Sep 17 08:25:49.503294 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.503208 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerStarted","Data":"0d3e6d6bc1153bbdbb1801f3e366e9eb97d8c6460d1b1ee7779c57ff5fb73540"} Sep 17 08:25:49.504912 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.504832 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" event={"ID":"34e5fd67-3cda-4873-85e7-4df55bae9e4e","Type":"ContainerStarted","Data":"e5e1c4ece432b675f56a3716cbe6ac2ac7ab81842deadbefa3f57d92e8e281d8"} Sep 17 08:25:49.505944 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.505916 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-6kpmz" Sep 17 08:25:49.508019 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.508004 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbc7df9dd-mdt4l" event={"ID":"902a3dd7-2ce4-4359-9854-1b42645c6ef5","Type":"ContainerStarted","Data":"df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca"} Sep 17 08:25:49.508140 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.508129 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbc7df9dd-mdt4l" event={"ID":"902a3dd7-2ce4-4359-9854-1b42645c6ef5","Type":"ContainerStarted","Data":"ec5776e3890b9f699a163646090c7f326e75cf51e18048b485f9082c83dc66ff"} Sep 17 08:25:49.510544 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.510125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" event={"ID":"db72abcf-53e6-49be-93dc-2de5d216afb5","Type":"ContainerStarted","Data":"007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193"} Sep 17 08:25:49.510544 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.510155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" event={"ID":"db72abcf-53e6-49be-93dc-2de5d216afb5","Type":"ContainerStarted","Data":"4c1e90311c0a16da58b57cfd0f75e3da177282777459a50db016460244a0db45"} Sep 17 08:25:49.510544 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.510505 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:25:49.517606 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.515810 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-6kpmz" podStartSLOduration=2.0046316 podStartE2EDuration="19.515799209s" totalImagesPullingTime="17.511167609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:49.51529859 +0000 UTC m=+104.982810873" watchObservedRunningTime="2026-09-17 08:25:49.515799209 +0000 UTC m=+104.983311482" Sep 17 08:25:49.579927 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:49.579863 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fbc7df9dd-mdt4l" podStartSLOduration=2.579836769 podStartE2EDuration="2.579836769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:49.557195942 +0000 UTC m=+105.024708225" watchObservedRunningTime="2026-09-17 08:25:49.579836769 +0000 UTC m=+105.047349089" Sep 17 08:25:54.559093 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.558808 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" event={"ID":"277fe07c-d1ca-4c36-b0e3-e929d06cb6a5","Type":"ContainerStarted","Data":"c4f527360ad807d591ca9edc7ec7420813903f37f960d4aa987e5ee397b1f0d2"} Sep 17 08:25:54.564757 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.563662 2580 generic.go:356] "Generic (PLEG): container finished" podID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerID="ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5" exitCode=0 Sep 17 08:25:54.564757 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.563770 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerDied","Data":"ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5"} Sep 17 08:25:54.568645 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.568200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6v95x" event={"ID":"8789481a-50e3-47d6-8f93-2689fbb7b6f0","Type":"ContainerStarted","Data":"db5fc28f55092849a957e6f954a3a3c50a884386c2f0c9a5c5cf40d2fe8ba57b"} Sep 17 08:25:54.579650 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.578651 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jpv9q" podStartSLOduration=8.626409713 podStartE2EDuration="13.57860273s" totalImagesPullingTime="4.952193017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:54.577566906 +0000 UTC m=+110.045079190" watchObservedRunningTime="2026-09-17 08:25:54.57860273 +0000 UTC m=+110.046115013" Sep 17 08:25:54.579650 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.579369 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" podStartSLOduration=109.579352673 podStartE2EDuration="1m49.579352673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:49.580554002 +0000 UTC m=+105.048066285" watchObservedRunningTime="2026-09-17 08:25:54.579352673 +0000 UTC m=+110.046864956" Sep 17 08:25:54.582303 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.582272 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" event={"ID":"922ed2eb-6779-424c-94e3-6160667139be","Type":"ContainerStarted","Data":"66d7a644a384f5076f4fe65761406ad03de6c1ec9827de6ff624483685966679"} Sep 17 08:25:54.591322 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.590945 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerID="71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239" exitCode=0 Sep 17 08:25:54.591322 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.591215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerDied","Data":"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239"} Sep 17 08:25:54.680501 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:54.680398 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" podStartSLOduration=3.551970575 podStartE2EDuration="8.680372452s" totalImagesPullingTime="5.128401877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:54.677508997 +0000 UTC m=+110.145021280" watchObservedRunningTime="2026-09-17 08:25:54.680372452 +0000 UTC m=+110.147884737" Sep 17 08:25:55.202597 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.202561 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fd69d4f5b-mmkh7"] Sep 17 08:25:55.606651 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.606220 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dlqhq" event={"ID":"50a808da-fe8f-434a-be74-e7ac5abaf4fe","Type":"ContainerStarted","Data":"6e06de6cea7b2df03f36b759832ccbc9af00430b48a55dfd295f05d033d05329"} Sep 17 08:25:55.606651 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.606296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dlqhq" event={"ID":"50a808da-fe8f-434a-be74-e7ac5abaf4fe","Type":"ContainerStarted","Data":"5b56a9a29f39683b79a19bbff1168a2acfff6a860b91a4d90800d7ad8da8f505"} Sep 17 08:25:55.607309 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.606773 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dlqhq" Sep 17 08:25:55.610073 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.610041 2580 generic.go:356] "Generic (PLEG): container finished" podID="8789481a-50e3-47d6-8f93-2689fbb7b6f0" containerID="db5fc28f55092849a957e6f954a3a3c50a884386c2f0c9a5c5cf40d2fe8ba57b" exitCode=0 Sep 17 08:25:55.610205 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.610077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6v95x" event={"ID":"8789481a-50e3-47d6-8f93-2689fbb7b6f0","Type":"ContainerDied","Data":"db5fc28f55092849a957e6f954a3a3c50a884386c2f0c9a5c5cf40d2fe8ba57b"} Sep 17 08:25:55.613764 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.613725 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" event={"ID":"34e5fd67-3cda-4873-85e7-4df55bae9e4e","Type":"ContainerStarted","Data":"9622a5e5f65dfc4f723fd28b1997dee724fcf6a8264cfa42dd13602df668804e"} Sep 17 08:25:55.613871 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.613785 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" event={"ID":"34e5fd67-3cda-4873-85e7-4df55bae9e4e","Type":"ContainerStarted","Data":"6cc0ae5c6b4da7f0cca2ef6b174256727a88011260ca8c9a29ff3bba4513397d"} Sep 17 08:25:55.613871 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.613815 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" event={"ID":"34e5fd67-3cda-4873-85e7-4df55bae9e4e","Type":"ContainerStarted","Data":"191e27cb024ffd32d9f8993f5b568d33646897dc01a28045760ef3f0eb368a06"} Sep 17 08:25:55.660580 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.660526 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dlqhq" podStartSLOduration=72.597325908 podStartE2EDuration="1m17.660503426s" totalImagesPullingTime="5.063177518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:55.636918223 +0000 UTC m=+111.104430505" watchObservedRunningTime="2026-09-17 08:25:55.660503426 +0000 UTC m=+111.128015710" Sep 17 08:25:55.681585 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:55.681527 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6qxqn" podStartSLOduration=9.625668 podStartE2EDuration="14.681497765s" totalImagesPullingTime="5.055829765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:55.680028832 +0000 UTC m=+111.147541111" watchObservedRunningTime="2026-09-17 08:25:55.681497765 +0000 UTC m=+111.149010047" Sep 17 08:25:56.624879 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:56.624798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6v95x" event={"ID":"8789481a-50e3-47d6-8f93-2689fbb7b6f0","Type":"ContainerStarted","Data":"aa993a93d58dfaeb11730a02948e04ad187c79872d7f3da87b62d800c9544de3"} Sep 17 08:25:56.625568 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:56.625514 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6v95x" event={"ID":"8789481a-50e3-47d6-8f93-2689fbb7b6f0","Type":"ContainerStarted","Data":"a8beb90f5f6be4d611eb888f90514a306f09514481aa2e794386527b089e33fb"} Sep 17 08:25:56.645822 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:56.645758 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6v95x" podStartSLOduration=10.496336537 podStartE2EDuration="15.645736303s" totalImagesPullingTime="4.981798896s" totalInitContainerRuntime="167.60087ms" isStatefulPod=true podCreationTimestamp="2026-09-17 08:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:25:56.645119926 +0000 UTC m=+112.112632209" watchObservedRunningTime="2026-09-17 08:25:56.645736303 +0000 UTC m=+112.113248587" Sep 17 08:25:57.882021 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:57.881974 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:57.882525 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:57.882046 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:57.887851 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:57.887788 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:58.647358 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:58.647327 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerStarted","Data":"1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317"} Sep 17 08:25:58.651810 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:58.651789 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:25:59.656199 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:59.656157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerStarted","Data":"27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939"} Sep 17 08:25:59.656764 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:59.656257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerStarted","Data":"d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b"} Sep 17 08:25:59.656764 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:59.656302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerStarted","Data":"c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490"} Sep 17 08:25:59.656764 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:59.656345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerStarted","Data":"943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd"} Sep 17 08:25:59.658914 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:59.658828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerStarted","Data":"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b"} Sep 17 08:25:59.659040 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:25:59.658972 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerStarted","Data":"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda"} Sep 17 08:26:01.674302 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:01.674262 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerStarted","Data":"a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071"} Sep 17 08:26:01.699830 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:01.699789 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.778323567 podStartE2EDuration="19.699772464s" totalImagesPullingTime="10.900906089s" totalInitContainerRuntime="20.542808ms" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:26:01.697607306 +0000 UTC m=+117.165119588" watchObservedRunningTime="2026-09-17 08:26:01.699772464 +0000 UTC m=+117.167284746" Sep 17 08:26:02.681514 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:02.681478 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerStarted","Data":"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e"} Sep 17 08:26:02.682119 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:02.681608 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerStarted","Data":"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a"} Sep 17 08:26:02.682119 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:02.681657 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerStarted","Data":"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d"} Sep 17 08:26:02.682119 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:02.681681 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerStarted","Data":"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f"} Sep 17 08:26:02.724209 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:02.724156 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.689258354 podStartE2EDuration="14.724139048s" totalImagesPullingTime="10.00429584s" totalInitContainerRuntime="30.584854ms" isStatefulPod=false podCreationTimestamp="2026-09-17 08:25:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:26:02.721556623 +0000 UTC m=+118.189068900" watchObservedRunningTime="2026-09-17 08:26:02.724139048 +0000 UTC m=+118.191651330" Sep 17 08:26:03.369474 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:03.369442 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:26:05.208711 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:05.208681 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:26:05.628231 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:05.628203 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dlqhq" Sep 17 08:26:06.492127 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:06.492099 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:26:06.492499 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:06.492155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:26:12.531400 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.531360 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5974c87cf7-2hbqq" podUID="2ab49c52-01de-4e60-a34d-4452304e443e" containerName="console" containerID="cri-o://8e7b0839be54a8eda16439a150e0a748a060c568d0489be3ab8a78ec1c6f434b" gracePeriod=15 Sep 17 08:26:12.725359 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.725231 2580 generic.go:356] "Generic (PLEG): container finished" podID="2ab49c52-01de-4e60-a34d-4452304e443e" containerID="8e7b0839be54a8eda16439a150e0a748a060c568d0489be3ab8a78ec1c6f434b" exitCode=0 Sep 17 08:26:12.725359 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.725280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5974c87cf7-2hbqq" event={"ID":"2ab49c52-01de-4e60-a34d-4452304e443e","Type":"ContainerDied","Data":"8e7b0839be54a8eda16439a150e0a748a060c568d0489be3ab8a78ec1c6f434b"} Sep 17 08:26:12.811430 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.811405 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:26:12.885755 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.885727 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-oauth-config\") pod \"2ab49c52-01de-4e60-a34d-4452304e443e\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " Sep 17 08:26:12.885755 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.885760 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-serving-cert\") pod \"2ab49c52-01de-4e60-a34d-4452304e443e\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " Sep 17 08:26:12.885948 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.885799 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-service-ca\") pod \"2ab49c52-01de-4e60-a34d-4452304e443e\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " Sep 17 08:26:12.885948 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.885930 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-console-config\") pod \"2ab49c52-01de-4e60-a34d-4452304e443e\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " Sep 17 08:26:12.886055 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.885986 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-oauth-serving-cert\") pod \"2ab49c52-01de-4e60-a34d-4452304e443e\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " Sep 17 08:26:12.886055 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.886018 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9bvv\" (UniqueName: \"kubernetes.io/projected/2ab49c52-01de-4e60-a34d-4452304e443e-kube-api-access-f9bvv\") pod \"2ab49c52-01de-4e60-a34d-4452304e443e\" (UID: \"2ab49c52-01de-4e60-a34d-4452304e443e\") " Sep 17 08:26:12.886150 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.886091 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ab49c52-01de-4e60-a34d-4452304e443e" (UID: "2ab49c52-01de-4e60-a34d-4452304e443e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:26:12.886291 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.886266 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-console-config" (OuterVolumeSpecName: "console-config") pod "2ab49c52-01de-4e60-a34d-4452304e443e" (UID: "2ab49c52-01de-4e60-a34d-4452304e443e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:26:12.886419 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.886359 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-service-ca\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:12.886419 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.886354 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ab49c52-01de-4e60-a34d-4452304e443e" (UID: "2ab49c52-01de-4e60-a34d-4452304e443e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:26:12.886419 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.886373 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-console-config\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:12.888220 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.888195 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ab49c52-01de-4e60-a34d-4452304e443e" (UID: "2ab49c52-01de-4e60-a34d-4452304e443e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:26:12.888297 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.888234 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ab49c52-01de-4e60-a34d-4452304e443e" (UID: "2ab49c52-01de-4e60-a34d-4452304e443e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:26:12.888341 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.888309 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab49c52-01de-4e60-a34d-4452304e443e-kube-api-access-f9bvv" (OuterVolumeSpecName: "kube-api-access-f9bvv") pod "2ab49c52-01de-4e60-a34d-4452304e443e" (UID: "2ab49c52-01de-4e60-a34d-4452304e443e"). InnerVolumeSpecName "kube-api-access-f9bvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:26:12.987019 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.986991 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-oauth-config\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:12.987019 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.987016 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab49c52-01de-4e60-a34d-4452304e443e-console-serving-cert\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:12.987156 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.987026 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ab49c52-01de-4e60-a34d-4452304e443e-oauth-serving-cert\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:12.987156 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:12.987035 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9bvv\" (UniqueName: \"kubernetes.io/projected/2ab49c52-01de-4e60-a34d-4452304e443e-kube-api-access-f9bvv\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:13.731414 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:13.731389 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5974c87cf7-2hbqq" Sep 17 08:26:13.731805 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:13.731386 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5974c87cf7-2hbqq" event={"ID":"2ab49c52-01de-4e60-a34d-4452304e443e","Type":"ContainerDied","Data":"9d193340e16879d2175b7fd39dd150d6571b51959654075affa1fa5737d2cb75"} Sep 17 08:26:13.741388 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:13.741363 2580 scope.go:117] "RemoveContainer" containerID="8e7b0839be54a8eda16439a150e0a748a060c568d0489be3ab8a78ec1c6f434b" Sep 17 08:26:13.747679 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:13.747656 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5974c87cf7-2hbqq"] Sep 17 08:26:13.751131 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:13.751113 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5974c87cf7-2hbqq"] Sep 17 08:26:14.800860 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:14.800828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:26:14.803201 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:14.803181 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edc69206-7d0f-4086-964c-77facc99d777-metrics-certs\") pod \"network-metrics-daemon-xjrm2\" (UID: \"edc69206-7d0f-4086-964c-77facc99d777\") " pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:26:15.056278 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:15.056189 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab49c52-01de-4e60-a34d-4452304e443e" path="/var/lib/kubelet/pods/2ab49c52-01de-4e60-a34d-4452304e443e/volumes" Sep 17 08:26:15.068934 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:15.068909 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lfcxg\"" Sep 17 08:26:15.077220 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:15.077203 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjrm2" Sep 17 08:26:15.371668 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:15.371637 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xjrm2"] Sep 17 08:26:15.373509 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:26:15.373476 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc69206_7d0f_4086_964c_77facc99d777.slice/crio-f248438937da9bc11380adfc189167087d327477c22a92c89f52ad37a5aefb61 WatchSource:0}: Error finding container f248438937da9bc11380adfc189167087d327477c22a92c89f52ad37a5aefb61: Status 404 returned error can't find the container with id f248438937da9bc11380adfc189167087d327477c22a92c89f52ad37a5aefb61 Sep 17 08:26:15.742021 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:15.741944 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xjrm2" event={"ID":"edc69206-7d0f-4086-964c-77facc99d777","Type":"ContainerStarted","Data":"f248438937da9bc11380adfc189167087d327477c22a92c89f52ad37a5aefb61"} Sep 17 08:26:17.754663 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:17.754614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xjrm2" event={"ID":"edc69206-7d0f-4086-964c-77facc99d777","Type":"ContainerStarted","Data":"31ee10994b77251b77492e41f457de8fd4185f130a4745ff717172172dae0ebb"} Sep 17 08:26:17.755036 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:17.754682 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xjrm2" event={"ID":"edc69206-7d0f-4086-964c-77facc99d777","Type":"ContainerStarted","Data":"dd2d979d57a67c9039bef7f6e0fa366ce4827e1c4fe0cee4cacf63eb71e20dc0"} Sep 17 08:26:17.771954 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:17.771907 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xjrm2" podStartSLOduration=131.329194673 podStartE2EDuration="2m12.771893247s" totalImagesPullingTime="1.442698574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:26:17.770896131 +0000 UTC m=+133.238408414" watchObservedRunningTime="2026-09-17 08:26:17.771893247 +0000 UTC m=+133.239405529" Sep 17 08:26:20.225188 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.225145 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" podUID="db72abcf-53e6-49be-93dc-2de5d216afb5" containerName="registry" containerID="cri-o://007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193" gracePeriod=30 Sep 17 08:26:20.461829 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.461807 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:26:20.553321 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553292 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-image-registry-private-configuration\") pod \"db72abcf-53e6-49be-93dc-2de5d216afb5\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " Sep 17 08:26:20.553484 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553353 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") pod \"db72abcf-53e6-49be-93dc-2de5d216afb5\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " Sep 17 08:26:20.553484 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553415 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-certificates\") pod \"db72abcf-53e6-49be-93dc-2de5d216afb5\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " Sep 17 08:26:20.553484 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553440 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-trusted-ca\") pod \"db72abcf-53e6-49be-93dc-2de5d216afb5\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " Sep 17 08:26:20.553484 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553470 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-bound-sa-token\") pod \"db72abcf-53e6-49be-93dc-2de5d216afb5\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " Sep 17 08:26:20.553731 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553524 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db72abcf-53e6-49be-93dc-2de5d216afb5-ca-trust-extracted\") pod \"db72abcf-53e6-49be-93dc-2de5d216afb5\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " Sep 17 08:26:20.553731 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553565 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc8fv\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-kube-api-access-zc8fv\") pod \"db72abcf-53e6-49be-93dc-2de5d216afb5\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " Sep 17 08:26:20.553731 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553591 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-installation-pull-secrets\") pod \"db72abcf-53e6-49be-93dc-2de5d216afb5\" (UID: \"db72abcf-53e6-49be-93dc-2de5d216afb5\") " Sep 17 08:26:20.554001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553949 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "db72abcf-53e6-49be-93dc-2de5d216afb5" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:26:20.554001 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.553958 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "db72abcf-53e6-49be-93dc-2de5d216afb5" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:26:20.556009 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.555977 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "db72abcf-53e6-49be-93dc-2de5d216afb5" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:26:20.556009 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.555989 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "db72abcf-53e6-49be-93dc-2de5d216afb5" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:26:20.556258 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.556234 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "db72abcf-53e6-49be-93dc-2de5d216afb5" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:26:20.556408 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.556375 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-kube-api-access-zc8fv" (OuterVolumeSpecName: "kube-api-access-zc8fv") pod "db72abcf-53e6-49be-93dc-2de5d216afb5" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5"). InnerVolumeSpecName "kube-api-access-zc8fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:26:20.556454 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.556427 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "db72abcf-53e6-49be-93dc-2de5d216afb5" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:26:20.562410 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.562386 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db72abcf-53e6-49be-93dc-2de5d216afb5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "db72abcf-53e6-49be-93dc-2de5d216afb5" (UID: "db72abcf-53e6-49be-93dc-2de5d216afb5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 08:26:20.654743 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.654703 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db72abcf-53e6-49be-93dc-2de5d216afb5-ca-trust-extracted\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:20.654743 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.654738 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc8fv\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-kube-api-access-zc8fv\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:20.654743 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.654749 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-installation-pull-secrets\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:20.654956 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.654761 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db72abcf-53e6-49be-93dc-2de5d216afb5-image-registry-private-configuration\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:20.654956 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.654771 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-tls\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:20.654956 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.654778 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-registry-certificates\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:20.654956 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.654786 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db72abcf-53e6-49be-93dc-2de5d216afb5-trusted-ca\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:20.654956 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.654794 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db72abcf-53e6-49be-93dc-2de5d216afb5-bound-sa-token\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:26:20.768701 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.768669 2580 generic.go:356] "Generic (PLEG): container finished" podID="db72abcf-53e6-49be-93dc-2de5d216afb5" containerID="007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193" exitCode=0 Sep 17 08:26:20.768823 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.768712 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" event={"ID":"db72abcf-53e6-49be-93dc-2de5d216afb5","Type":"ContainerDied","Data":"007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193"} Sep 17 08:26:20.768823 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.768719 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" Sep 17 08:26:20.768823 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.768750 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd69d4f5b-mmkh7" event={"ID":"db72abcf-53e6-49be-93dc-2de5d216afb5","Type":"ContainerDied","Data":"4c1e90311c0a16da58b57cfd0f75e3da177282777459a50db016460244a0db45"} Sep 17 08:26:20.768823 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.768770 2580 scope.go:117] "RemoveContainer" containerID="007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193" Sep 17 08:26:20.777306 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.777289 2580 scope.go:117] "RemoveContainer" containerID="007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193" Sep 17 08:26:20.777585 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:26:20.777566 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193\": container with ID starting with 007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193 not found: ID does not exist" containerID="007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193" Sep 17 08:26:20.777680 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.777591 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193"} err="failed to get container status \"007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193\": rpc error: code = NotFound desc = could not find container \"007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193\": container with ID starting with 007a1d60e0004e3bc98a87f46251f01816ac669e0276c50d8f12843dee9c2193 not found: ID does not exist" Sep 17 08:26:20.789192 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.789168 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fd69d4f5b-mmkh7"] Sep 17 08:26:20.792660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:20.792635 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5fd69d4f5b-mmkh7"] Sep 17 08:26:21.056050 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:21.056020 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db72abcf-53e6-49be-93dc-2de5d216afb5" path="/var/lib/kubelet/pods/db72abcf-53e6-49be-93dc-2de5d216afb5/volumes" Sep 17 08:26:26.497895 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:26.497858 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:26:26.501576 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:26.501539 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-99b4cdcbf-hscx4" Sep 17 08:26:48.369208 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:48.369174 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:26:48.388076 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:48.388044 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:26:48.902532 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:26:48.902504 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:02.101361 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.101287 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 08:27:02.101758 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.101568 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="alertmanager" containerID="cri-o://1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317" gracePeriod=120 Sep 17 08:27:02.101758 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.101662 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy-metric" containerID="cri-o://27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939" gracePeriod=120 Sep 17 08:27:02.101758 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.101669 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy-web" containerID="cri-o://c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490" gracePeriod=120 Sep 17 08:27:02.101758 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.101722 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="prom-label-proxy" containerID="cri-o://a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071" gracePeriod=120 Sep 17 08:27:02.102081 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.101683 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="config-reloader" containerID="cri-o://943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd" gracePeriod=120 Sep 17 08:27:02.102081 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.101692 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy" containerID="cri-o://d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b" gracePeriod=120 Sep 17 08:27:02.945798 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.945757 2580 generic.go:356] "Generic (PLEG): container finished" podID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerID="a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071" exitCode=0 Sep 17 08:27:02.945798 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.945782 2580 generic.go:356] "Generic (PLEG): container finished" podID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerID="d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b" exitCode=0 Sep 17 08:27:02.945798 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.945789 2580 generic.go:356] "Generic (PLEG): container finished" podID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerID="943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd" exitCode=0 Sep 17 08:27:02.945798 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.945795 2580 generic.go:356] "Generic (PLEG): container finished" podID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerID="1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317" exitCode=0 Sep 17 08:27:02.946101 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.945828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerDied","Data":"a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071"} Sep 17 08:27:02.946101 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.945902 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerDied","Data":"d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b"} Sep 17 08:27:02.946101 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.945940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerDied","Data":"943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd"} Sep 17 08:27:02.946101 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:02.945974 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerDied","Data":"1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317"} Sep 17 08:27:03.347630 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.347594 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:27:03.414507 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414475 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-cluster-tls-config\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.414507 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414513 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.414768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414530 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-tls-assets\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.414768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414552 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.414768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414571 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk7cg\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-kube-api-access-lk7cg\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.414768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414598 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.414768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414652 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-trusted-ca-bundle\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.414768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414689 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-web-config\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.414768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414711 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-metrics-client-ca\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.414768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414752 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-main-db\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.415159 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414779 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-main-tls\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.415159 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414800 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-volume\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.415159 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.414879 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-out\") pod \"9435b6f4-c770-43a2-a169-a73346dcf5b7\" (UID: \"9435b6f4-c770-43a2-a169-a73346dcf5b7\") " Sep 17 08:27:03.415361 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.415328 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:03.416086 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.415967 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:03.417514 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.417454 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:03.417654 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.417539 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 08:27:03.418038 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.417996 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-kube-api-access-lk7cg" (OuterVolumeSpecName: "kube-api-access-lk7cg") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "kube-api-access-lk7cg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:27:03.418724 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.418684 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:03.418831 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.418723 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-out" (OuterVolumeSpecName: "config-out") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 08:27:03.419542 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.419512 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:03.419681 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.419550 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:03.419755 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.419731 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:27:03.420005 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.419985 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-volume" (OuterVolumeSpecName: "config-volume") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:03.422747 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.422722 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:03.429773 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.429751 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-web-config" (OuterVolumeSpecName: "web-config") pod "9435b6f4-c770-43a2-a169-a73346dcf5b7" (UID: "9435b6f4-c770-43a2-a169-a73346dcf5b7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:03.516338 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516260 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-web-config\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516338 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516298 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-metrics-client-ca\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516338 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516312 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-main-db\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516338 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516325 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-main-tls\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516338 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516338 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-volume\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516349 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9435b6f4-c770-43a2-a169-a73346dcf5b7-config-out\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516360 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-cluster-tls-config\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516372 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516383 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-tls-assets\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516395 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516410 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk7cg\" (UniqueName: \"kubernetes.io/projected/9435b6f4-c770-43a2-a169-a73346dcf5b7-kube-api-access-lk7cg\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516422 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9435b6f4-c770-43a2-a169-a73346dcf5b7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.516578 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.516435 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9435b6f4-c770-43a2-a169-a73346dcf5b7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:03.952830 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.952797 2580 generic.go:356] "Generic (PLEG): container finished" podID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerID="27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939" exitCode=0 Sep 17 08:27:03.952830 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.952820 2580 generic.go:356] "Generic (PLEG): container finished" podID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerID="c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490" exitCode=0 Sep 17 08:27:03.953038 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.952873 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 08:27:03.953038 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.952878 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerDied","Data":"27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939"} Sep 17 08:27:03.953038 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.952943 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerDied","Data":"c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490"} Sep 17 08:27:03.953038 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.952973 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9435b6f4-c770-43a2-a169-a73346dcf5b7","Type":"ContainerDied","Data":"d2c887d7a12e769181bf0e114b6e495f00fdf1ee8576e23c0b1f9e259678657d"} Sep 17 08:27:03.953038 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.953002 2580 scope.go:117] "RemoveContainer" containerID="a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071" Sep 17 08:27:03.965135 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.965114 2580 scope.go:117] "RemoveContainer" containerID="27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939" Sep 17 08:27:03.972277 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.972260 2580 scope.go:117] "RemoveContainer" containerID="d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b" Sep 17 08:27:03.979824 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.979807 2580 scope.go:117] "RemoveContainer" containerID="c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490" Sep 17 08:27:03.982061 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.982009 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 08:27:03.987178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.986428 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 08:27:03.989998 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.989983 2580 scope.go:117] "RemoveContainer" containerID="943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd" Sep 17 08:27:03.996885 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:03.996859 2580 scope.go:117] "RemoveContainer" containerID="1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317" Sep 17 08:27:04.004750 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.004734 2580 scope.go:117] "RemoveContainer" containerID="ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5" Sep 17 08:27:04.012111 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.012096 2580 scope.go:117] "RemoveContainer" containerID="a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071" Sep 17 08:27:04.012394 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:04.012372 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071\": container with ID starting with a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071 not found: ID does not exist" containerID="a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071" Sep 17 08:27:04.012457 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.012403 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071"} err="failed to get container status \"a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071\": rpc error: code = NotFound desc = could not find container \"a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071\": container with ID starting with a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071 not found: ID does not exist" Sep 17 08:27:04.012457 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.012419 2580 scope.go:117] "RemoveContainer" containerID="27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939" Sep 17 08:27:04.012719 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:04.012702 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939\": container with ID starting with 27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939 not found: ID does not exist" containerID="27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939" Sep 17 08:27:04.012766 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.012724 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939"} err="failed to get container status \"27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939\": rpc error: code = NotFound desc = could not find container \"27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939\": container with ID starting with 27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939 not found: ID does not exist" Sep 17 08:27:04.012766 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.012740 2580 scope.go:117] "RemoveContainer" containerID="d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b" Sep 17 08:27:04.012970 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:04.012953 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b\": container with ID starting with d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b not found: ID does not exist" containerID="d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b" Sep 17 08:27:04.013023 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.012973 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b"} err="failed to get container status \"d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b\": rpc error: code = NotFound desc = could not find container \"d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b\": container with ID starting with d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b not found: ID does not exist" Sep 17 08:27:04.013023 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.012985 2580 scope.go:117] "RemoveContainer" containerID="c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490" Sep 17 08:27:04.013254 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:04.013230 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490\": container with ID starting with c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490 not found: ID does not exist" containerID="c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490" Sep 17 08:27:04.013315 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.013261 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490"} err="failed to get container status \"c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490\": rpc error: code = NotFound desc = could not find container \"c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490\": container with ID starting with c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490 not found: ID does not exist" Sep 17 08:27:04.013315 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.013277 2580 scope.go:117] "RemoveContainer" containerID="943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd" Sep 17 08:27:04.013533 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:04.013517 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd\": container with ID starting with 943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd not found: ID does not exist" containerID="943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd" Sep 17 08:27:04.013599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.013536 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd"} err="failed to get container status \"943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd\": rpc error: code = NotFound desc = could not find container \"943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd\": container with ID starting with 943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd not found: ID does not exist" Sep 17 08:27:04.013599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.013548 2580 scope.go:117] "RemoveContainer" containerID="1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317" Sep 17 08:27:04.013878 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:04.013859 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317\": container with ID starting with 1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317 not found: ID does not exist" containerID="1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317" Sep 17 08:27:04.013919 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.013883 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317"} err="failed to get container status \"1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317\": rpc error: code = NotFound desc = could not find container \"1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317\": container with ID starting with 1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317 not found: ID does not exist" Sep 17 08:27:04.013919 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.013897 2580 scope.go:117] "RemoveContainer" containerID="ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5" Sep 17 08:27:04.014148 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:04.014130 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5\": container with ID starting with ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5 not found: ID does not exist" containerID="ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5" Sep 17 08:27:04.014184 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.014161 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5"} err="failed to get container status \"ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5\": rpc error: code = NotFound desc = could not find container \"ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5\": container with ID starting with ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5 not found: ID does not exist" Sep 17 08:27:04.014184 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.014175 2580 scope.go:117] "RemoveContainer" containerID="a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071" Sep 17 08:27:04.014410 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.014395 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071"} err="failed to get container status \"a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071\": rpc error: code = NotFound desc = could not find container \"a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071\": container with ID starting with a613ef4e168a3fe90be6085e3059ee934f196a6d41aee22a10cdf447f5b1e071 not found: ID does not exist" Sep 17 08:27:04.014448 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.014411 2580 scope.go:117] "RemoveContainer" containerID="27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939" Sep 17 08:27:04.014614 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.014598 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939"} err="failed to get container status \"27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939\": rpc error: code = NotFound desc = could not find container \"27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939\": container with ID starting with 27a01738364e56615d0daa909d219b6e329317263377055fcb4ea9f20f6ac939 not found: ID does not exist" Sep 17 08:27:04.014675 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.014616 2580 scope.go:117] "RemoveContainer" containerID="d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b" Sep 17 08:27:04.014862 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.014846 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b"} err="failed to get container status \"d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b\": rpc error: code = NotFound desc = could not find container \"d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b\": container with ID starting with d23d3e963e1cfec9902da191d2a9214a910b087847f78a28ffa1911a33598f3b not found: ID does not exist" Sep 17 08:27:04.014913 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.014861 2580 scope.go:117] "RemoveContainer" containerID="c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490" Sep 17 08:27:04.015088 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.015065 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490"} err="failed to get container status \"c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490\": rpc error: code = NotFound desc = could not find container \"c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490\": container with ID starting with c3b9c2588cb99eeba1f5f72706e1e7c43d9dce14706570660969b601f7894490 not found: ID does not exist" Sep 17 08:27:04.015150 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.015089 2580 scope.go:117] "RemoveContainer" containerID="943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd" Sep 17 08:27:04.015302 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.015283 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd"} err="failed to get container status \"943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd\": rpc error: code = NotFound desc = could not find container \"943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd\": container with ID starting with 943f68bdefdf54d25873d19977479d7f7a14166eecc0034220b02b8e52b29bbd not found: ID does not exist" Sep 17 08:27:04.015343 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.015303 2580 scope.go:117] "RemoveContainer" containerID="1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317" Sep 17 08:27:04.015556 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.015541 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317"} err="failed to get container status \"1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317\": rpc error: code = NotFound desc = could not find container \"1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317\": container with ID starting with 1f604b9639407e67d29f8d5696322e4c92a752bdcc65f5dd27cec34c9e1a4317 not found: ID does not exist" Sep 17 08:27:04.015595 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.015555 2580 scope.go:117] "RemoveContainer" containerID="ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5" Sep 17 08:27:04.015800 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:04.015782 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5"} err="failed to get container status \"ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5\": rpc error: code = NotFound desc = could not find container \"ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5\": container with ID starting with ad429deb56f0ca57cf961716210344ca16fd3a3f1fac6105ef528b03551639e5 not found: ID does not exist" Sep 17 08:27:05.055612 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:05.055585 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" path="/var/lib/kubelet/pods/9435b6f4-c770-43a2-a169-a73346dcf5b7/volumes" Sep 17 08:27:06.434073 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.434041 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 08:27:06.434473 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.434329 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="prometheus" containerID="cri-o://b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" gracePeriod=600 Sep 17 08:27:06.434473 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.434343 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy" containerID="cri-o://e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" gracePeriod=600 Sep 17 08:27:06.434473 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.434380 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy-web" containerID="cri-o://48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" gracePeriod=600 Sep 17 08:27:06.434473 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.434373 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" gracePeriod=600 Sep 17 08:27:06.434473 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.434382 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="thanos-sidecar" containerID="cri-o://e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" gracePeriod=600 Sep 17 08:27:06.434473 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.434429 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="config-reloader" containerID="cri-o://d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" gracePeriod=600 Sep 17 08:27:06.668460 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.668430 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:06.743177 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743096 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-grpc-tls\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743177 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743143 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-tls\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743177 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743165 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-thanos-prometheus-http-client-file\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743191 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-trusted-ca-bundle\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743232 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-kube-rbac-proxy\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743271 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-serving-certs-ca-bundle\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743293 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-2\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743322 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config-out\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743348 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d5fd\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-kube-api-access-5d5fd\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743382 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-web-config\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743411 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-0\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743437 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743462 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.743488 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743486 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-tls-assets\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.744013 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743515 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-metrics-client-certs\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.744013 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743549 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-1\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.744013 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743578 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-db\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.744013 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743604 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.744013 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743679 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-metrics-client-ca\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.744013 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.743714 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-kubelet-serving-ca-bundle\") pod \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\" (UID: \"2d3076f5-4f16-4a0c-8666-e8bfedd3530b\") " Sep 17 08:27:06.744305 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.744109 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:06.744611 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.744526 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:06.744611 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.744541 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:06.745105 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.744860 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:06.746656 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.746571 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:06.746656 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.746581 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:06.746819 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.746682 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:06.746819 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.746703 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:06.747133 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.747095 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 08:27:06.747319 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.747296 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:06.747532 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.747500 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:06.747812 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.747770 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config-out" (OuterVolumeSpecName: "config-out") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 08:27:06.748074 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.748040 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:06.748452 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.748410 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-kube-api-access-5d5fd" (OuterVolumeSpecName: "kube-api-access-5d5fd") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "kube-api-access-5d5fd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:27:06.749470 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.749444 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:06.749470 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.749464 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config" (OuterVolumeSpecName: "config") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:06.749805 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.749786 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:06.750097 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.750078 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:06.750097 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.750086 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:27:06.758766 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.758737 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-web-config" (OuterVolumeSpecName: "web-config") pod "2d3076f5-4f16-4a0c-8666-e8bfedd3530b" (UID: "2d3076f5-4f16-4a0c-8666-e8bfedd3530b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:06.844950 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.844923 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-kube-rbac-proxy\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.844950 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.844949 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845096 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.844965 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845096 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.844980 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config-out\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845096 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.844993 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d5fd\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-kube-api-access-5d5fd\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845096 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845030 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-web-config\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845096 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845043 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845096 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845058 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-config\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845096 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845072 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845096 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845086 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-tls-assets\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845099 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-metrics-client-certs\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845111 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845127 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-k8s-db\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845139 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845152 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-metrics-client-ca\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845166 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845180 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-grpc-tls\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845193 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845206 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.845387 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.845219 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3076f5-4f16-4a0c-8666-e8bfedd3530b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:06.969907 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.969876 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerID="7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" exitCode=0 Sep 17 08:27:06.969907 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.969901 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerID="e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" exitCode=0 Sep 17 08:27:06.969907 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.969907 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerID="48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" exitCode=0 Sep 17 08:27:06.969907 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.969913 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerID="e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" exitCode=0 Sep 17 08:27:06.970149 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.969918 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerID="d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" exitCode=0 Sep 17 08:27:06.970149 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.969923 2580 generic.go:356] "Generic (PLEG): container finished" podID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerID="b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" exitCode=0 Sep 17 08:27:06.970149 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.969946 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:06.970149 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.969962 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerDied","Data":"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e"} Sep 17 08:27:06.970149 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.970051 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerDied","Data":"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a"} Sep 17 08:27:06.970149 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.970078 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerDied","Data":"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d"} Sep 17 08:27:06.970149 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.970102 2580 scope.go:117] "RemoveContainer" containerID="7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" Sep 17 08:27:06.970476 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.970109 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerDied","Data":"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f"} Sep 17 08:27:06.970476 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.970218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerDied","Data":"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b"} Sep 17 08:27:06.970476 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.970245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerDied","Data":"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda"} Sep 17 08:27:06.970476 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.970275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2d3076f5-4f16-4a0c-8666-e8bfedd3530b","Type":"ContainerDied","Data":"0d3e6d6bc1153bbdbb1801f3e366e9eb97d8c6460d1b1ee7779c57ff5fb73540"} Sep 17 08:27:06.978669 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.978651 2580 scope.go:117] "RemoveContainer" containerID="e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" Sep 17 08:27:06.985917 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.985902 2580 scope.go:117] "RemoveContainer" containerID="48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" Sep 17 08:27:06.992783 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.992762 2580 scope.go:117] "RemoveContainer" containerID="e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" Sep 17 08:27:06.994381 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.994362 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 08:27:06.998689 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.998668 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 08:27:06.999951 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:06.999939 2580 scope.go:117] "RemoveContainer" containerID="d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" Sep 17 08:27:07.006693 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.006676 2580 scope.go:117] "RemoveContainer" containerID="b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" Sep 17 08:27:07.013498 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.013480 2580 scope.go:117] "RemoveContainer" containerID="71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239" Sep 17 08:27:07.020269 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.020255 2580 scope.go:117] "RemoveContainer" containerID="7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" Sep 17 08:27:07.020554 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:07.020531 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": container with ID starting with 7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e not found: ID does not exist" containerID="7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" Sep 17 08:27:07.020598 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.020556 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e"} err="failed to get container status \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": rpc error: code = NotFound desc = could not find container \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": container with ID starting with 7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e not found: ID does not exist" Sep 17 08:27:07.020598 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.020572 2580 scope.go:117] "RemoveContainer" containerID="e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" Sep 17 08:27:07.020856 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:07.020840 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": container with ID starting with e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a not found: ID does not exist" containerID="e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" Sep 17 08:27:07.020904 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.020860 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a"} err="failed to get container status \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": rpc error: code = NotFound desc = could not find container \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": container with ID starting with e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a not found: ID does not exist" Sep 17 08:27:07.020904 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.020875 2580 scope.go:117] "RemoveContainer" containerID="48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" Sep 17 08:27:07.021139 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:07.021120 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": container with ID starting with 48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d not found: ID does not exist" containerID="48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" Sep 17 08:27:07.021215 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.021142 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d"} err="failed to get container status \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": rpc error: code = NotFound desc = could not find container \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": container with ID starting with 48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d not found: ID does not exist" Sep 17 08:27:07.021215 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.021159 2580 scope.go:117] "RemoveContainer" containerID="e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" Sep 17 08:27:07.021404 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:07.021388 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": container with ID starting with e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f not found: ID does not exist" containerID="e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" Sep 17 08:27:07.021440 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.021411 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f"} err="failed to get container status \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": rpc error: code = NotFound desc = could not find container \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": container with ID starting with e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f not found: ID does not exist" Sep 17 08:27:07.021440 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.021423 2580 scope.go:117] "RemoveContainer" containerID="d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" Sep 17 08:27:07.021680 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:07.021661 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": container with ID starting with d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b not found: ID does not exist" containerID="d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" Sep 17 08:27:07.021727 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.021690 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b"} err="failed to get container status \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": rpc error: code = NotFound desc = could not find container \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": container with ID starting with d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b not found: ID does not exist" Sep 17 08:27:07.021727 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.021706 2580 scope.go:117] "RemoveContainer" containerID="b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" Sep 17 08:27:07.021967 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:07.021946 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": container with ID starting with b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda not found: ID does not exist" containerID="b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" Sep 17 08:27:07.022045 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.021971 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda"} err="failed to get container status \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": rpc error: code = NotFound desc = could not find container \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": container with ID starting with b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda not found: ID does not exist" Sep 17 08:27:07.022045 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.021984 2580 scope.go:117] "RemoveContainer" containerID="71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239" Sep 17 08:27:07.022237 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:07.022222 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": container with ID starting with 71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239 not found: ID does not exist" containerID="71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239" Sep 17 08:27:07.022280 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.022240 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239"} err="failed to get container status \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": rpc error: code = NotFound desc = could not find container \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": container with ID starting with 71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239 not found: ID does not exist" Sep 17 08:27:07.022280 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.022255 2580 scope.go:117] "RemoveContainer" containerID="7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" Sep 17 08:27:07.022471 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.022455 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e"} err="failed to get container status \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": rpc error: code = NotFound desc = could not find container \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": container with ID starting with 7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e not found: ID does not exist" Sep 17 08:27:07.022509 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.022471 2580 scope.go:117] "RemoveContainer" containerID="e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" Sep 17 08:27:07.022748 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.022730 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a"} err="failed to get container status \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": rpc error: code = NotFound desc = could not find container \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": container with ID starting with e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a not found: ID does not exist" Sep 17 08:27:07.022748 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.022747 2580 scope.go:117] "RemoveContainer" containerID="48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" Sep 17 08:27:07.022932 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.022915 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d"} err="failed to get container status \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": rpc error: code = NotFound desc = could not find container \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": container with ID starting with 48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d not found: ID does not exist" Sep 17 08:27:07.022975 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.022932 2580 scope.go:117] "RemoveContainer" containerID="e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" Sep 17 08:27:07.023153 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.023139 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f"} err="failed to get container status \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": rpc error: code = NotFound desc = could not find container \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": container with ID starting with e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f not found: ID does not exist" Sep 17 08:27:07.023191 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.023154 2580 scope.go:117] "RemoveContainer" containerID="d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" Sep 17 08:27:07.023390 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.023376 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b"} err="failed to get container status \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": rpc error: code = NotFound desc = could not find container \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": container with ID starting with d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b not found: ID does not exist" Sep 17 08:27:07.023390 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.023389 2580 scope.go:117] "RemoveContainer" containerID="b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" Sep 17 08:27:07.023652 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.023636 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda"} err="failed to get container status \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": rpc error: code = NotFound desc = could not find container \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": container with ID starting with b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda not found: ID does not exist" Sep 17 08:27:07.023652 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.023651 2580 scope.go:117] "RemoveContainer" containerID="71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239" Sep 17 08:27:07.023875 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.023858 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239"} err="failed to get container status \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": rpc error: code = NotFound desc = could not find container \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": container with ID starting with 71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239 not found: ID does not exist" Sep 17 08:27:07.023922 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.023875 2580 scope.go:117] "RemoveContainer" containerID="7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" Sep 17 08:27:07.024080 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024066 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e"} err="failed to get container status \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": rpc error: code = NotFound desc = could not find container \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": container with ID starting with 7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e not found: ID does not exist" Sep 17 08:27:07.024123 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024080 2580 scope.go:117] "RemoveContainer" containerID="e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" Sep 17 08:27:07.024280 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024265 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a"} err="failed to get container status \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": rpc error: code = NotFound desc = could not find container \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": container with ID starting with e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a not found: ID does not exist" Sep 17 08:27:07.024318 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024279 2580 scope.go:117] "RemoveContainer" containerID="48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" Sep 17 08:27:07.024485 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024468 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d"} err="failed to get container status \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": rpc error: code = NotFound desc = could not find container \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": container with ID starting with 48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d not found: ID does not exist" Sep 17 08:27:07.024527 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024486 2580 scope.go:117] "RemoveContainer" containerID="e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" Sep 17 08:27:07.024720 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024704 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f"} err="failed to get container status \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": rpc error: code = NotFound desc = could not find container \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": container with ID starting with e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f not found: ID does not exist" Sep 17 08:27:07.024768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024720 2580 scope.go:117] "RemoveContainer" containerID="d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" Sep 17 08:27:07.024905 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024886 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b"} err="failed to get container status \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": rpc error: code = NotFound desc = could not find container \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": container with ID starting with d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b not found: ID does not exist" Sep 17 08:27:07.024905 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.024902 2580 scope.go:117] "RemoveContainer" containerID="b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" Sep 17 08:27:07.025113 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025096 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda"} err="failed to get container status \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": rpc error: code = NotFound desc = could not find container \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": container with ID starting with b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda not found: ID does not exist" Sep 17 08:27:07.025113 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025113 2580 scope.go:117] "RemoveContainer" containerID="71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239" Sep 17 08:27:07.025309 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025293 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239"} err="failed to get container status \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": rpc error: code = NotFound desc = could not find container \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": container with ID starting with 71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239 not found: ID does not exist" Sep 17 08:27:07.025355 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025309 2580 scope.go:117] "RemoveContainer" containerID="7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" Sep 17 08:27:07.025517 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025501 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e"} err="failed to get container status \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": rpc error: code = NotFound desc = could not find container \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": container with ID starting with 7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e not found: ID does not exist" Sep 17 08:27:07.025517 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025516 2580 scope.go:117] "RemoveContainer" containerID="e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" Sep 17 08:27:07.025713 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025694 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a"} err="failed to get container status \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": rpc error: code = NotFound desc = could not find container \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": container with ID starting with e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a not found: ID does not exist" Sep 17 08:27:07.025774 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025716 2580 scope.go:117] "RemoveContainer" containerID="48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" Sep 17 08:27:07.025979 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025959 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d"} err="failed to get container status \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": rpc error: code = NotFound desc = could not find container \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": container with ID starting with 48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d not found: ID does not exist" Sep 17 08:27:07.026019 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.025981 2580 scope.go:117] "RemoveContainer" containerID="e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" Sep 17 08:27:07.026224 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.026206 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f"} err="failed to get container status \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": rpc error: code = NotFound desc = could not find container \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": container with ID starting with e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f not found: ID does not exist" Sep 17 08:27:07.026271 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.026226 2580 scope.go:117] "RemoveContainer" containerID="d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" Sep 17 08:27:07.026456 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.026441 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b"} err="failed to get container status \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": rpc error: code = NotFound desc = could not find container \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": container with ID starting with d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b not found: ID does not exist" Sep 17 08:27:07.026505 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.026457 2580 scope.go:117] "RemoveContainer" containerID="b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" Sep 17 08:27:07.026654 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.026635 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda"} err="failed to get container status \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": rpc error: code = NotFound desc = could not find container \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": container with ID starting with b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda not found: ID does not exist" Sep 17 08:27:07.026700 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.026655 2580 scope.go:117] "RemoveContainer" containerID="71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239" Sep 17 08:27:07.026907 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.026888 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239"} err="failed to get container status \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": rpc error: code = NotFound desc = could not find container \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": container with ID starting with 71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239 not found: ID does not exist" Sep 17 08:27:07.026982 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.026908 2580 scope.go:117] "RemoveContainer" containerID="7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" Sep 17 08:27:07.027114 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.027096 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e"} err="failed to get container status \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": rpc error: code = NotFound desc = could not find container \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": container with ID starting with 7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e not found: ID does not exist" Sep 17 08:27:07.027179 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.027115 2580 scope.go:117] "RemoveContainer" containerID="e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" Sep 17 08:27:07.027320 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.027303 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a"} err="failed to get container status \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": rpc error: code = NotFound desc = could not find container \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": container with ID starting with e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a not found: ID does not exist" Sep 17 08:27:07.027361 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.027320 2580 scope.go:117] "RemoveContainer" containerID="48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" Sep 17 08:27:07.027553 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.027536 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d"} err="failed to get container status \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": rpc error: code = NotFound desc = could not find container \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": container with ID starting with 48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d not found: ID does not exist" Sep 17 08:27:07.027611 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.027554 2580 scope.go:117] "RemoveContainer" containerID="e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" Sep 17 08:27:07.027796 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.027779 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f"} err="failed to get container status \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": rpc error: code = NotFound desc = could not find container \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": container with ID starting with e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f not found: ID does not exist" Sep 17 08:27:07.027845 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.027797 2580 scope.go:117] "RemoveContainer" containerID="d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" Sep 17 08:27:07.027999 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.027980 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b"} err="failed to get container status \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": rpc error: code = NotFound desc = could not find container \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": container with ID starting with d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b not found: ID does not exist" Sep 17 08:27:07.028060 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.028000 2580 scope.go:117] "RemoveContainer" containerID="b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" Sep 17 08:27:07.028238 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.028220 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda"} err="failed to get container status \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": rpc error: code = NotFound desc = could not find container \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": container with ID starting with b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda not found: ID does not exist" Sep 17 08:27:07.028285 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.028240 2580 scope.go:117] "RemoveContainer" containerID="71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239" Sep 17 08:27:07.028440 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.028421 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239"} err="failed to get container status \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": rpc error: code = NotFound desc = could not find container \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": container with ID starting with 71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239 not found: ID does not exist" Sep 17 08:27:07.028509 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.028442 2580 scope.go:117] "RemoveContainer" containerID="7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e" Sep 17 08:27:07.028693 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.028677 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e"} err="failed to get container status \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": rpc error: code = NotFound desc = could not find container \"7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e\": container with ID starting with 7605086543b725fd4e9571bc554f41f5838e7c28a7223fdfd26430600efd050e not found: ID does not exist" Sep 17 08:27:07.028761 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.028694 2580 scope.go:117] "RemoveContainer" containerID="e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a" Sep 17 08:27:07.028889 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.028874 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a"} err="failed to get container status \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": rpc error: code = NotFound desc = could not find container \"e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a\": container with ID starting with e32cc9adcb660715dce229a00eab493b105819ad6becf32665a2d31434f8501a not found: ID does not exist" Sep 17 08:27:07.028953 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.028890 2580 scope.go:117] "RemoveContainer" containerID="48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d" Sep 17 08:27:07.029135 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.029119 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d"} err="failed to get container status \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": rpc error: code = NotFound desc = could not find container \"48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d\": container with ID starting with 48309413fb85bc13124dab02f7f659f3f5f68ff8f8fff19ddcb037adc8c72c1d not found: ID does not exist" Sep 17 08:27:07.029178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.029136 2580 scope.go:117] "RemoveContainer" containerID="e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f" Sep 17 08:27:07.029334 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.029318 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f"} err="failed to get container status \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": rpc error: code = NotFound desc = could not find container \"e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f\": container with ID starting with e269af8976f355d9b80d2ab4b1b3477881e407526218d4ab34a4b846b55c144f not found: ID does not exist" Sep 17 08:27:07.029374 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.029335 2580 scope.go:117] "RemoveContainer" containerID="d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b" Sep 17 08:27:07.029554 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.029537 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b"} err="failed to get container status \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": rpc error: code = NotFound desc = could not find container \"d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b\": container with ID starting with d6c9a0c3ff0283adac2a5881d4f52e974a806e4957a08481085a10a965790e4b not found: ID does not exist" Sep 17 08:27:07.029637 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.029558 2580 scope.go:117] "RemoveContainer" containerID="b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda" Sep 17 08:27:07.029806 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.029790 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda"} err="failed to get container status \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": rpc error: code = NotFound desc = could not find container \"b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda\": container with ID starting with b1b6803e51078f270ce293644643a988217d59b86a02ad2df8bc0658be171cda not found: ID does not exist" Sep 17 08:27:07.029866 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.029808 2580 scope.go:117] "RemoveContainer" containerID="71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239" Sep 17 08:27:07.030026 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.030009 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239"} err="failed to get container status \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": rpc error: code = NotFound desc = could not find container \"71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239\": container with ID starting with 71a2a33536c86cdd8a6c7216848c26f13d2c212181569971db3f8bf044091239 not found: ID does not exist" Sep 17 08:27:07.032870 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.032848 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 08:27:07.033150 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033135 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy" Sep 17 08:27:07.033224 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033153 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy" Sep 17 08:27:07.033224 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033165 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy-thanos" Sep 17 08:27:07.033224 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033173 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy-thanos" Sep 17 08:27:07.033224 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033186 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="config-reloader" Sep 17 08:27:07.033224 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033194 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="config-reloader" Sep 17 08:27:07.033224 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033204 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy-metric" Sep 17 08:27:07.033224 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033212 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy-metric" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033227 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="init-config-reloader" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033235 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="init-config-reloader" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033248 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy-web" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033257 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy-web" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033270 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy-web" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033278 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy-web" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033288 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033296 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033307 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="alertmanager" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033315 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="alertmanager" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033324 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="prometheus" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033331 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="prometheus" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033340 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="prom-label-proxy" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033348 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="prom-label-proxy" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033360 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db72abcf-53e6-49be-93dc-2de5d216afb5" containerName="registry" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033368 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="db72abcf-53e6-49be-93dc-2de5d216afb5" containerName="registry" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033376 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="init-config-reloader" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033383 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="init-config-reloader" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033395 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="thanos-sidecar" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033403 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="thanos-sidecar" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033413 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab49c52-01de-4e60-a34d-4452304e443e" containerName="console" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033422 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab49c52-01de-4e60-a34d-4452304e443e" containerName="console" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033432 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="config-reloader" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033440 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="config-reloader" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033510 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="alertmanager" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033522 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy-web" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033532 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033540 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="kube-rbac-proxy-thanos" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033549 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="prometheus" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033557 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy-metric" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033566 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="prom-label-proxy" Sep 17 08:27:07.033557 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033573 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="config-reloader" Sep 17 08:27:07.035041 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033590 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="config-reloader" Sep 17 08:27:07.035041 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033599 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy" Sep 17 08:27:07.035041 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033608 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="db72abcf-53e6-49be-93dc-2de5d216afb5" containerName="registry" Sep 17 08:27:07.035041 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033634 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" containerName="thanos-sidecar" Sep 17 08:27:07.035041 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033643 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9435b6f4-c770-43a2-a169-a73346dcf5b7" containerName="kube-rbac-proxy-web" Sep 17 08:27:07.035041 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.033651 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab49c52-01de-4e60-a34d-4452304e443e" containerName="console" Sep 17 08:27:07.039106 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.039084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.042026 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042009 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 08:27:07.042149 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042094 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 08:27:07.042227 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042181 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 08:27:07.042227 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042182 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 08:27:07.042333 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042287 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 08:27:07.042653 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042639 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 08:27:07.042733 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042661 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 08:27:07.042774 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042730 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mrppk\"" Sep 17 08:27:07.042826 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042812 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 08:27:07.042890 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.042874 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 08:27:07.043020 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.043006 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 08:27:07.043172 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.043153 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 08:27:07.043240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.043153 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 08:27:07.044167 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.044148 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fe8v62llqdcev\"" Sep 17 08:27:07.045613 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.045594 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 08:27:07.047709 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.047693 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 08:27:07.055363 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.055343 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d3076f5-4f16-4a0c-8666-e8bfedd3530b" path="/var/lib/kubelet/pods/2d3076f5-4f16-4a0c-8666-e8bfedd3530b/volumes" Sep 17 08:27:07.061733 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.061708 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 08:27:07.147567 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147716 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147716 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-web-config\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147716 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147682 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147716 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147716 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147716 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147928 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147928 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147928 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147770 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147928 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147928 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147928 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147928 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.147928 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.148288 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-config-out\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.148288 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.147983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztprk\" (UniqueName: \"kubernetes.io/projected/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-kube-api-access-ztprk\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.148288 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.148104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.148288 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.148132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-config\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.148288 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.148149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.148288 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.148183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249348 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249348 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249348 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249348 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249339 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249435 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249461 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-config-out\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249540 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztprk\" (UniqueName: \"kubernetes.io/projected/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-kube-api-access-ztprk\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.249605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-config\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.250147 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.250147 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.250147 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.250147 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.250147 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.249773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-web-config\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.250147 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.250000 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.250610 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.250226 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.250851 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.250817 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.252370 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.252263 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.253115 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.252819 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.253115 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.252852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.253115 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.252915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.253115 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.252944 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-web-config\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.253115 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.252944 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.253609 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.253242 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.254098 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.254068 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.254289 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.254265 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.254355 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.254287 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.254476 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.254449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.254560 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.254547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.255140 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.255119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-config-out\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.255272 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.255256 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.255742 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.255722 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.255813 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.255754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-config\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.258921 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.258905 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztprk\" (UniqueName: \"kubernetes.io/projected/21388a6f-3783-4bc5-9312-6e9d7ed3dd33-kube-api-access-ztprk\") pod \"prometheus-k8s-0\" (UID: \"21388a6f-3783-4bc5-9312-6e9d7ed3dd33\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.349024 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.349001 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:07.628868 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.628837 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 08:27:07.632909 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:27:07.632883 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21388a6f_3783_4bc5_9312_6e9d7ed3dd33.slice/crio-684bbe92db8abc18cb547fa40a75989edc2d2151db944469435e917cf6c29f25 WatchSource:0}: Error finding container 684bbe92db8abc18cb547fa40a75989edc2d2151db944469435e917cf6c29f25: Status 404 returned error can't find the container with id 684bbe92db8abc18cb547fa40a75989edc2d2151db944469435e917cf6c29f25 Sep 17 08:27:07.975933 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.975855 2580 generic.go:356] "Generic (PLEG): container finished" podID="21388a6f-3783-4bc5-9312-6e9d7ed3dd33" containerID="d3554cb1bc1d6f045b261250711d8deee48d92f21e55ff2d1adaf97a9ba5d632" exitCode=0 Sep 17 08:27:07.975933 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.975900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21388a6f-3783-4bc5-9312-6e9d7ed3dd33","Type":"ContainerDied","Data":"d3554cb1bc1d6f045b261250711d8deee48d92f21e55ff2d1adaf97a9ba5d632"} Sep 17 08:27:07.976097 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:07.975949 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21388a6f-3783-4bc5-9312-6e9d7ed3dd33","Type":"ContainerStarted","Data":"684bbe92db8abc18cb547fa40a75989edc2d2151db944469435e917cf6c29f25"} Sep 17 08:27:08.984026 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:08.983994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21388a6f-3783-4bc5-9312-6e9d7ed3dd33","Type":"ContainerStarted","Data":"d47958f95f962847dc99eb1462f2024bec1a064c17fed62280b49f93fb10f7b7"} Sep 17 08:27:08.984390 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:08.984058 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21388a6f-3783-4bc5-9312-6e9d7ed3dd33","Type":"ContainerStarted","Data":"5f1b682c0b7c83c8ffe07f773bfc8071859790d025863d5efc29053fb8de88e3"} Sep 17 08:27:08.984390 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:08.984085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21388a6f-3783-4bc5-9312-6e9d7ed3dd33","Type":"ContainerStarted","Data":"41fa3007729d1ef6a9ce0a7629986a471377bd1e0fd9b03de3207f620d5ff703"} Sep 17 08:27:08.984390 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:08.984110 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21388a6f-3783-4bc5-9312-6e9d7ed3dd33","Type":"ContainerStarted","Data":"26685c41867ff16ffc9cacc4760c7cac79074fd02ca565435a1b63f0e495f2f8"} Sep 17 08:27:08.984390 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:08.984135 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21388a6f-3783-4bc5-9312-6e9d7ed3dd33","Type":"ContainerStarted","Data":"11fecca9295467c7e5b9f31f120832b3932dc4ce090416a4d9daf20063cb8dbd"} Sep 17 08:27:08.984390 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:08.984158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"21388a6f-3783-4bc5-9312-6e9d7ed3dd33","Type":"ContainerStarted","Data":"e60226db82ed5f8543a432505eb520d641aa61c452dbe91cfcf6817b9955b6b3"} Sep 17 08:27:09.014590 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:09.014531 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.9967523169999999 podStartE2EDuration="2.014507493s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.755176ms" isStatefulPod=false podCreationTimestamp="2026-09-17 08:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:27:09.011876813 +0000 UTC m=+184.479389121" watchObservedRunningTime="2026-09-17 08:27:09.014507493 +0000 UTC m=+184.482019777" Sep 17 08:27:12.349957 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:12.349908 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:27:20.653262 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:20.653228 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbc7df9dd-mdt4l"] Sep 17 08:27:45.672974 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:45.672908 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fbc7df9dd-mdt4l" podUID="902a3dd7-2ce4-4359-9854-1b42645c6ef5" containerName="console" containerID="cri-o://df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca" gracePeriod=15 Sep 17 08:27:45.913196 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:45.913173 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:27:46.056861 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.056829 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-trusted-ca-bundle\") pod \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " Sep 17 08:27:46.057029 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.056910 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-serving-cert\") pod \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " Sep 17 08:27:46.057029 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.056938 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-service-ca\") pod \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " Sep 17 08:27:46.057029 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.056961 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-oauth-config\") pod \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " Sep 17 08:27:46.057029 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.057000 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-oauth-serving-cert\") pod \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " Sep 17 08:27:46.057212 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.057096 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-config\") pod \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " Sep 17 08:27:46.057212 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.057143 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsgd8\" (UniqueName: \"kubernetes.io/projected/902a3dd7-2ce4-4359-9854-1b42645c6ef5-kube-api-access-lsgd8\") pod \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\" (UID: \"902a3dd7-2ce4-4359-9854-1b42645c6ef5\") " Sep 17 08:27:46.057445 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.057409 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "902a3dd7-2ce4-4359-9854-1b42645c6ef5" (UID: "902a3dd7-2ce4-4359-9854-1b42645c6ef5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:46.057568 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.057452 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-service-ca" (OuterVolumeSpecName: "service-ca") pod "902a3dd7-2ce4-4359-9854-1b42645c6ef5" (UID: "902a3dd7-2ce4-4359-9854-1b42645c6ef5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:46.057568 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.057485 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "902a3dd7-2ce4-4359-9854-1b42645c6ef5" (UID: "902a3dd7-2ce4-4359-9854-1b42645c6ef5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:46.057568 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.057527 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-config" (OuterVolumeSpecName: "console-config") pod "902a3dd7-2ce4-4359-9854-1b42645c6ef5" (UID: "902a3dd7-2ce4-4359-9854-1b42645c6ef5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 08:27:46.059437 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.059417 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/902a3dd7-2ce4-4359-9854-1b42645c6ef5-kube-api-access-lsgd8" (OuterVolumeSpecName: "kube-api-access-lsgd8") pod "902a3dd7-2ce4-4359-9854-1b42645c6ef5" (UID: "902a3dd7-2ce4-4359-9854-1b42645c6ef5"). InnerVolumeSpecName "kube-api-access-lsgd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:27:46.059733 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.059707 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "902a3dd7-2ce4-4359-9854-1b42645c6ef5" (UID: "902a3dd7-2ce4-4359-9854-1b42645c6ef5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:46.059733 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.059723 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "902a3dd7-2ce4-4359-9854-1b42645c6ef5" (UID: "902a3dd7-2ce4-4359-9854-1b42645c6ef5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 08:27:46.128471 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.128444 2580 generic.go:356] "Generic (PLEG): container finished" podID="902a3dd7-2ce4-4359-9854-1b42645c6ef5" containerID="df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca" exitCode=0 Sep 17 08:27:46.128615 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.128488 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbc7df9dd-mdt4l" Sep 17 08:27:46.128615 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.128504 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbc7df9dd-mdt4l" event={"ID":"902a3dd7-2ce4-4359-9854-1b42645c6ef5","Type":"ContainerDied","Data":"df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca"} Sep 17 08:27:46.128615 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.128543 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbc7df9dd-mdt4l" event={"ID":"902a3dd7-2ce4-4359-9854-1b42645c6ef5","Type":"ContainerDied","Data":"ec5776e3890b9f699a163646090c7f326e75cf51e18048b485f9082c83dc66ff"} Sep 17 08:27:46.128615 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.128561 2580 scope.go:117] "RemoveContainer" containerID="df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca" Sep 17 08:27:46.137121 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.137103 2580 scope.go:117] "RemoveContainer" containerID="df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca" Sep 17 08:27:46.137390 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:27:46.137370 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca\": container with ID starting with df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca not found: ID does not exist" containerID="df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca" Sep 17 08:27:46.137435 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.137398 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca"} err="failed to get container status \"df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca\": rpc error: code = NotFound desc = could not find container \"df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca\": container with ID starting with df21d7417549723d84fc032804eceac01970ef89e633e7be3fbb68856769f6ca not found: ID does not exist" Sep 17 08:27:46.149073 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.149051 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbc7df9dd-mdt4l"] Sep 17 08:27:46.154172 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.154151 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fbc7df9dd-mdt4l"] Sep 17 08:27:46.157981 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.157961 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-oauth-serving-cert\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:46.158073 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.157984 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-config\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:46.158073 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.158000 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsgd8\" (UniqueName: \"kubernetes.io/projected/902a3dd7-2ce4-4359-9854-1b42645c6ef5-kube-api-access-lsgd8\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:46.158073 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.158014 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-trusted-ca-bundle\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:46.158073 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.158026 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-serving-cert\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:46.158073 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.158036 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/902a3dd7-2ce4-4359-9854-1b42645c6ef5-service-ca\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:46.158073 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:46.158050 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/902a3dd7-2ce4-4359-9854-1b42645c6ef5-console-oauth-config\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:27:47.055706 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:27:47.055671 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="902a3dd7-2ce4-4359-9854-1b42645c6ef5" path="/var/lib/kubelet/pods/902a3dd7-2ce4-4359-9854-1b42645c6ef5/volumes" Sep 17 08:28:07.350027 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:28:07.349982 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:28:07.365651 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:28:07.365606 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:28:08.232665 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:28:08.232614 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 08:29:04.955933 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:04.955907 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 08:29:53.545354 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.545321 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xn59m"] Sep 17 08:29:53.545883 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.545683 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="902a3dd7-2ce4-4359-9854-1b42645c6ef5" containerName="console" Sep 17 08:29:53.545883 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.545699 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="902a3dd7-2ce4-4359-9854-1b42645c6ef5" containerName="console" Sep 17 08:29:53.545883 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.545767 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="902a3dd7-2ce4-4359-9854-1b42645c6ef5" containerName="console" Sep 17 08:29:53.548681 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.548662 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" Sep 17 08:29:53.551396 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.551141 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 08:29:53.551396 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.551144 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 08:29:53.551396 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.551172 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qtpgk\"" Sep 17 08:29:53.556265 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.556239 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xn59m"] Sep 17 08:29:53.596668 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.596613 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lcv5\" (UniqueName: \"kubernetes.io/projected/ae2d433f-f3f3-45f0-99ec-645e349d8f91-kube-api-access-2lcv5\") pod \"cert-manager-cainjector-559cdd8c87-xn59m\" (UID: \"ae2d433f-f3f3-45f0-99ec-645e349d8f91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" Sep 17 08:29:53.596802 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.596698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae2d433f-f3f3-45f0-99ec-645e349d8f91-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xn59m\" (UID: \"ae2d433f-f3f3-45f0-99ec-645e349d8f91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" Sep 17 08:29:53.697810 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.697787 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lcv5\" (UniqueName: \"kubernetes.io/projected/ae2d433f-f3f3-45f0-99ec-645e349d8f91-kube-api-access-2lcv5\") pod \"cert-manager-cainjector-559cdd8c87-xn59m\" (UID: \"ae2d433f-f3f3-45f0-99ec-645e349d8f91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" Sep 17 08:29:53.697969 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.697830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae2d433f-f3f3-45f0-99ec-645e349d8f91-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xn59m\" (UID: \"ae2d433f-f3f3-45f0-99ec-645e349d8f91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" Sep 17 08:29:53.706037 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.706010 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae2d433f-f3f3-45f0-99ec-645e349d8f91-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xn59m\" (UID: \"ae2d433f-f3f3-45f0-99ec-645e349d8f91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" Sep 17 08:29:53.706037 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.706027 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lcv5\" (UniqueName: \"kubernetes.io/projected/ae2d433f-f3f3-45f0-99ec-645e349d8f91-kube-api-access-2lcv5\") pod \"cert-manager-cainjector-559cdd8c87-xn59m\" (UID: \"ae2d433f-f3f3-45f0-99ec-645e349d8f91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" Sep 17 08:29:53.867301 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:53.867222 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" Sep 17 08:29:54.138222 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:54.138196 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xn59m"] Sep 17 08:29:54.140146 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:29:54.140122 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae2d433f_f3f3_45f0_99ec_645e349d8f91.slice/crio-d62e58c4e5e6002b4cd425e96115095215a5cec4592d595ae5d8e12d70f09fa6 WatchSource:0}: Error finding container d62e58c4e5e6002b4cd425e96115095215a5cec4592d595ae5d8e12d70f09fa6: Status 404 returned error can't find the container with id d62e58c4e5e6002b4cd425e96115095215a5cec4592d595ae5d8e12d70f09fa6 Sep 17 08:29:54.142065 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:54.142050 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 08:29:54.603847 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:29:54.603818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" event={"ID":"ae2d433f-f3f3-45f0-99ec-645e349d8f91","Type":"ContainerStarted","Data":"d62e58c4e5e6002b4cd425e96115095215a5cec4592d595ae5d8e12d70f09fa6"} Sep 17 08:30:04.643590 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:30:04.643555 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" event={"ID":"ae2d433f-f3f3-45f0-99ec-645e349d8f91","Type":"ContainerStarted","Data":"a6dec31469b5dc4b8106dce847433a8c5ddec681e812dfff1bacabc3257af46a"} Sep 17 08:30:04.660528 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:30:04.660479 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xn59m" podStartSLOduration=1.8935239099999999 podStartE2EDuration="11.660464996s" totalImagesPullingTime="9.766941086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:30:04.659879877 +0000 UTC m=+360.127392156" watchObservedRunningTime="2026-09-17 08:30:04.660464996 +0000 UTC m=+360.127977278" Sep 17 08:31:06.789826 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.789796 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx"] Sep 17 08:31:06.792989 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.792973 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:06.795541 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.795514 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 17 08:31:06.796480 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.796455 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 17 08:31:06.796599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.796476 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-nbhgx\"" Sep 17 08:31:06.796599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.796465 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 17 08:31:06.796599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.796484 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 17 08:31:06.802436 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.802415 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx"] Sep 17 08:31:06.951689 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.951661 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvwtz\" (UniqueName: \"kubernetes.io/projected/a1867526-b319-4211-bfe9-bafa2091cabc-kube-api-access-bvwtz\") pod \"kubeflow-trainer-controller-manager-6d468fc749-ssrgx\" (UID: \"a1867526-b319-4211-bfe9-bafa2091cabc\") " pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:06.951854 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.951700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a1867526-b319-4211-bfe9-bafa2091cabc-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6d468fc749-ssrgx\" (UID: \"a1867526-b319-4211-bfe9-bafa2091cabc\") " pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:06.951854 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:06.951781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1867526-b319-4211-bfe9-bafa2091cabc-cert\") pod \"kubeflow-trainer-controller-manager-6d468fc749-ssrgx\" (UID: \"a1867526-b319-4211-bfe9-bafa2091cabc\") " pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:07.052439 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:07.052409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvwtz\" (UniqueName: \"kubernetes.io/projected/a1867526-b319-4211-bfe9-bafa2091cabc-kube-api-access-bvwtz\") pod \"kubeflow-trainer-controller-manager-6d468fc749-ssrgx\" (UID: \"a1867526-b319-4211-bfe9-bafa2091cabc\") " pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:07.052583 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:07.052448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a1867526-b319-4211-bfe9-bafa2091cabc-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6d468fc749-ssrgx\" (UID: \"a1867526-b319-4211-bfe9-bafa2091cabc\") " pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:07.052583 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:07.052487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1867526-b319-4211-bfe9-bafa2091cabc-cert\") pod \"kubeflow-trainer-controller-manager-6d468fc749-ssrgx\" (UID: \"a1867526-b319-4211-bfe9-bafa2091cabc\") " pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:07.053176 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:07.053157 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/a1867526-b319-4211-bfe9-bafa2091cabc-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6d468fc749-ssrgx\" (UID: \"a1867526-b319-4211-bfe9-bafa2091cabc\") " pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:07.054983 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:07.054963 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1867526-b319-4211-bfe9-bafa2091cabc-cert\") pod \"kubeflow-trainer-controller-manager-6d468fc749-ssrgx\" (UID: \"a1867526-b319-4211-bfe9-bafa2091cabc\") " pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:07.061605 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:07.061584 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvwtz\" (UniqueName: \"kubernetes.io/projected/a1867526-b319-4211-bfe9-bafa2091cabc-kube-api-access-bvwtz\") pod \"kubeflow-trainer-controller-manager-6d468fc749-ssrgx\" (UID: \"a1867526-b319-4211-bfe9-bafa2091cabc\") " pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:07.102549 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:07.102524 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:07.373348 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:07.373324 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx"] Sep 17 08:31:07.375432 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:31:07.375406 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1867526_b319_4211_bfe9_bafa2091cabc.slice/crio-bbe12c1d7a8670ffc8dd7c13bee0cc5737822da8c013108348f26452d301e506 WatchSource:0}: Error finding container bbe12c1d7a8670ffc8dd7c13bee0cc5737822da8c013108348f26452d301e506: Status 404 returned error can't find the container with id bbe12c1d7a8670ffc8dd7c13bee0cc5737822da8c013108348f26452d301e506 Sep 17 08:31:07.883470 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:07.883430 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" event={"ID":"a1867526-b319-4211-bfe9-bafa2091cabc","Type":"ContainerStarted","Data":"bbe12c1d7a8670ffc8dd7c13bee0cc5737822da8c013108348f26452d301e506"} Sep 17 08:31:09.892792 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:09.892750 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" event={"ID":"a1867526-b319-4211-bfe9-bafa2091cabc","Type":"ContainerStarted","Data":"03feb6801579d017e9dda5d3e34f5777898ebcad410e781c9a5017db3917f52b"} Sep 17 08:31:09.893167 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:09.892811 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:31:09.909062 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:09.909018 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" podStartSLOduration=1.57463361 podStartE2EDuration="3.909003836s" totalImagesPullingTime="2.334370226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:31:09.907400934 +0000 UTC m=+425.374913215" watchObservedRunningTime="2026-09-17 08:31:09.909003836 +0000 UTC m=+425.376516118" Sep 17 08:31:25.899047 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:25.898950 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" podUID="a1867526-b319-4211-bfe9-bafa2091cabc" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 08:31:40.898548 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:40.898505 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" podUID="a1867526-b319-4211-bfe9-bafa2091cabc" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 08:31:55.897393 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:31:55.897350 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" podUID="a1867526-b319-4211-bfe9-bafa2091cabc" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 08:32:10.897730 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:32:10.897690 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" podUID="a1867526-b319-4211-bfe9-bafa2091cabc" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 08:32:23.052396 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:32:23.052350 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" podUID="a1867526-b319-4211-bfe9-bafa2091cabc" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 17 08:32:38.055545 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:32:38.055511 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-6d468fc749-ssrgx" Sep 17 08:33:51.087202 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.087167 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw"] Sep 17 08:33:51.090431 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.090413 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" Sep 17 08:33:51.093010 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.092985 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"openshift-service-ca.crt\"" Sep 17 08:33:51.093139 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.093045 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"kube-root-ca.crt\"" Sep 17 08:33:51.093139 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.093123 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"default-dockercfg-wm27p\"" Sep 17 08:33:51.102489 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.102464 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw"] Sep 17 08:33:51.167285 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.167253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kcgc\" (UniqueName: \"kubernetes.io/projected/192276f4-a29b-48b5-97e1-35f7df3c1f82-kube-api-access-4kcgc\") pod \"progression-enabled-node-0-0-kg8nw\" (UID: \"192276f4-a29b-48b5-97e1-35f7df3c1f82\") " pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" Sep 17 08:33:51.268599 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.268565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kcgc\" (UniqueName: \"kubernetes.io/projected/192276f4-a29b-48b5-97e1-35f7df3c1f82-kube-api-access-4kcgc\") pod \"progression-enabled-node-0-0-kg8nw\" (UID: \"192276f4-a29b-48b5-97e1-35f7df3c1f82\") " pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" Sep 17 08:33:51.276253 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.276223 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kcgc\" (UniqueName: \"kubernetes.io/projected/192276f4-a29b-48b5-97e1-35f7df3c1f82-kube-api-access-4kcgc\") pod \"progression-enabled-node-0-0-kg8nw\" (UID: \"192276f4-a29b-48b5-97e1-35f7df3c1f82\") " pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" Sep 17 08:33:51.400808 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.400713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" Sep 17 08:33:51.669872 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:51.669838 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw"] Sep 17 08:33:51.672137 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:33:51.672097 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192276f4_a29b_48b5_97e1_35f7df3c1f82.slice/crio-f16c6428eba9e70aa9fa94788e33b67ca4a237968e59ae8c039530ac9fc96766 WatchSource:0}: Error finding container f16c6428eba9e70aa9fa94788e33b67ca4a237968e59ae8c039530ac9fc96766: Status 404 returned error can't find the container with id f16c6428eba9e70aa9fa94788e33b67ca4a237968e59ae8c039530ac9fc96766 Sep 17 08:33:52.506703 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:33:52.506657 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" event={"ID":"192276f4-a29b-48b5-97e1-35f7df3c1f82","Type":"ContainerStarted","Data":"f16c6428eba9e70aa9fa94788e33b67ca4a237968e59ae8c039530ac9fc96766"} Sep 17 08:35:31.961706 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:31.961664 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" event={"ID":"192276f4-a29b-48b5-97e1-35f7df3c1f82","Type":"ContainerStarted","Data":"601f116e1b24e0714099c7e98e6a6b72dbed686ec8465232df6df11e102b770b"} Sep 17 08:35:31.962136 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:31.961748 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" Sep 17 08:35:31.984966 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:31.984904 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" podStartSLOduration=1.225498041 podStartE2EDuration="1m40.98488341s" totalImagesPullingTime="1m39.759385369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:35:31.982947362 +0000 UTC m=+687.450459647" watchObservedRunningTime="2026-09-17 08:35:31.98488341 +0000 UTC m=+687.452395695" Sep 17 08:35:33.969031 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:33.969005 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" Sep 17 08:35:54.966572 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:54.966531 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" podUID="192276f4-a29b-48b5-97e1-35f7df3c1f82" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Sep 17 08:35:55.054460 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:55.054422 2580 generic.go:356] "Generic (PLEG): container finished" podID="192276f4-a29b-48b5-97e1-35f7df3c1f82" containerID="601f116e1b24e0714099c7e98e6a6b72dbed686ec8465232df6df11e102b770b" exitCode=0 Sep 17 08:35:55.057051 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:55.057023 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" event={"ID":"192276f4-a29b-48b5-97e1-35f7df3c1f82","Type":"ContainerDied","Data":"601f116e1b24e0714099c7e98e6a6b72dbed686ec8465232df6df11e102b770b"} Sep 17 08:35:56.203331 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:56.203302 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" Sep 17 08:35:56.352031 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:56.351952 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kcgc\" (UniqueName: \"kubernetes.io/projected/192276f4-a29b-48b5-97e1-35f7df3c1f82-kube-api-access-4kcgc\") pod \"192276f4-a29b-48b5-97e1-35f7df3c1f82\" (UID: \"192276f4-a29b-48b5-97e1-35f7df3c1f82\") " Sep 17 08:35:56.354197 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:56.354175 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/192276f4-a29b-48b5-97e1-35f7df3c1f82-kube-api-access-4kcgc" (OuterVolumeSpecName: "kube-api-access-4kcgc") pod "192276f4-a29b-48b5-97e1-35f7df3c1f82" (UID: "192276f4-a29b-48b5-97e1-35f7df3c1f82"). InnerVolumeSpecName "kube-api-access-4kcgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:35:56.453336 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:56.453301 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kcgc\" (UniqueName: \"kubernetes.io/projected/192276f4-a29b-48b5-97e1-35f7df3c1f82-kube-api-access-4kcgc\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:35:57.063240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.063211 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" Sep 17 08:35:57.063415 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.063237 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw" event={"ID":"192276f4-a29b-48b5-97e1-35f7df3c1f82","Type":"ContainerDied","Data":"f16c6428eba9e70aa9fa94788e33b67ca4a237968e59ae8c039530ac9fc96766"} Sep 17 08:35:57.063415 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.063292 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f16c6428eba9e70aa9fa94788e33b67ca4a237968e59ae8c039530ac9fc96766" Sep 17 08:35:57.565096 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.565061 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m"] Sep 17 08:35:57.565457 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.565351 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="192276f4-a29b-48b5-97e1-35f7df3c1f82" containerName="node" Sep 17 08:35:57.565457 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.565362 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="192276f4-a29b-48b5-97e1-35f7df3c1f82" containerName="node" Sep 17 08:35:57.565457 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.565416 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="192276f4-a29b-48b5-97e1-35f7df3c1f82" containerName="node" Sep 17 08:35:57.586314 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.586280 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m"] Sep 17 08:35:57.586483 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.586393 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" Sep 17 08:35:57.589140 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.589116 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"openshift-service-ca.crt\"" Sep 17 08:35:57.589264 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.589119 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"kube-root-ca.crt\"" Sep 17 08:35:57.589264 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.589128 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"default-dockercfg-wm27p\"" Sep 17 08:35:57.662505 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.662469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8bbm\" (UniqueName: \"kubernetes.io/projected/ceffd387-c3ac-462f-ba78-e0eaca3d3269-kube-api-access-b8bbm\") pod \"progression-disabled-node-0-0-v9q2m\" (UID: \"ceffd387-c3ac-462f-ba78-e0eaca3d3269\") " pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" Sep 17 08:35:57.763824 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.763789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8bbm\" (UniqueName: \"kubernetes.io/projected/ceffd387-c3ac-462f-ba78-e0eaca3d3269-kube-api-access-b8bbm\") pod \"progression-disabled-node-0-0-v9q2m\" (UID: \"ceffd387-c3ac-462f-ba78-e0eaca3d3269\") " pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" Sep 17 08:35:57.772509 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.772484 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8bbm\" (UniqueName: \"kubernetes.io/projected/ceffd387-c3ac-462f-ba78-e0eaca3d3269-kube-api-access-b8bbm\") pod \"progression-disabled-node-0-0-v9q2m\" (UID: \"ceffd387-c3ac-462f-ba78-e0eaca3d3269\") " pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" Sep 17 08:35:57.896178 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:57.896093 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" Sep 17 08:35:58.188776 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:58.188754 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m"] Sep 17 08:35:58.191283 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:35:58.191257 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceffd387_c3ac_462f_ba78_e0eaca3d3269.slice/crio-44d1ceb61829346d42676994974953b3f6d8f216bd27ae75cddca02de0ff6df4 WatchSource:0}: Error finding container 44d1ceb61829346d42676994974953b3f6d8f216bd27ae75cddca02de0ff6df4: Status 404 returned error can't find the container with id 44d1ceb61829346d42676994974953b3f6d8f216bd27ae75cddca02de0ff6df4 Sep 17 08:35:59.072381 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:59.072346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" event={"ID":"ceffd387-c3ac-462f-ba78-e0eaca3d3269","Type":"ContainerStarted","Data":"d8d168fe0f90dd39d070f6233c7b7cbe48cf9e0b083327bb228cd93e9d1bc927"} Sep 17 08:35:59.072846 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:59.072398 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" event={"ID":"ceffd387-c3ac-462f-ba78-e0eaca3d3269","Type":"ContainerStarted","Data":"44d1ceb61829346d42676994974953b3f6d8f216bd27ae75cddca02de0ff6df4"} Sep 17 08:35:59.072846 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:59.072485 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" Sep 17 08:35:59.090321 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:35:59.090265 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" podStartSLOduration=2.090247629 podStartE2EDuration="2.090247629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:35:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:35:59.089493544 +0000 UTC m=+714.557005826" watchObservedRunningTime="2026-09-17 08:35:59.090247629 +0000 UTC m=+714.557759911" Sep 17 08:36:00.075286 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:00.075257 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" Sep 17 08:36:22.073177 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:22.073135 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" podUID="ceffd387-c3ac-462f-ba78-e0eaca3d3269" containerName="node" probeResult="failure" output="Get \"http://10.132.0.27:28080/metrics\": dial tcp 10.132.0.27:28080: connect: connection refused" Sep 17 08:36:22.170990 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:22.170957 2580 generic.go:356] "Generic (PLEG): container finished" podID="ceffd387-c3ac-462f-ba78-e0eaca3d3269" containerID="d8d168fe0f90dd39d070f6233c7b7cbe48cf9e0b083327bb228cd93e9d1bc927" exitCode=0 Sep 17 08:36:22.171151 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:22.171025 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" event={"ID":"ceffd387-c3ac-462f-ba78-e0eaca3d3269","Type":"ContainerDied","Data":"d8d168fe0f90dd39d070f6233c7b7cbe48cf9e0b083327bb228cd93e9d1bc927"} Sep 17 08:36:23.297788 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:23.297757 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" Sep 17 08:36:23.365906 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:23.365868 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8bbm\" (UniqueName: \"kubernetes.io/projected/ceffd387-c3ac-462f-ba78-e0eaca3d3269-kube-api-access-b8bbm\") pod \"ceffd387-c3ac-462f-ba78-e0eaca3d3269\" (UID: \"ceffd387-c3ac-462f-ba78-e0eaca3d3269\") " Sep 17 08:36:23.368055 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:23.368035 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceffd387-c3ac-462f-ba78-e0eaca3d3269-kube-api-access-b8bbm" (OuterVolumeSpecName: "kube-api-access-b8bbm") pod "ceffd387-c3ac-462f-ba78-e0eaca3d3269" (UID: "ceffd387-c3ac-462f-ba78-e0eaca3d3269"). InnerVolumeSpecName "kube-api-access-b8bbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:36:23.467046 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:23.466959 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8bbm\" (UniqueName: \"kubernetes.io/projected/ceffd387-c3ac-462f-ba78-e0eaca3d3269-kube-api-access-b8bbm\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:36:24.180087 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:24.180061 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" Sep 17 08:36:24.180253 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:24.180064 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m" event={"ID":"ceffd387-c3ac-462f-ba78-e0eaca3d3269","Type":"ContainerDied","Data":"44d1ceb61829346d42676994974953b3f6d8f216bd27ae75cddca02de0ff6df4"} Sep 17 08:36:24.180253 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:24.180186 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44d1ceb61829346d42676994974953b3f6d8f216bd27ae75cddca02de0ff6df4" Sep 17 08:36:32.571992 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.571959 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq"] Sep 17 08:36:32.572431 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.572249 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceffd387-c3ac-462f-ba78-e0eaca3d3269" containerName="node" Sep 17 08:36:32.572431 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.572258 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceffd387-c3ac-462f-ba78-e0eaca3d3269" containerName="node" Sep 17 08:36:32.572431 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.572311 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceffd387-c3ac-462f-ba78-e0eaca3d3269" containerName="node" Sep 17 08:36:32.575187 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.575169 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" Sep 17 08:36:32.577810 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.577778 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"openshift-service-ca.crt\"" Sep 17 08:36:32.577938 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.577835 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"kube-root-ca.crt\"" Sep 17 08:36:32.577938 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.577885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"default-dockercfg-wm27p\"" Sep 17 08:36:32.584944 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.584918 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq"] Sep 17 08:36:32.642007 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.641977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g9jl\" (UniqueName: \"kubernetes.io/projected/0f44cf0e-dff1-4976-8a7d-d04d31c5b545-kube-api-access-4g9jl\") pod \"progression-invalid-node-0-0-65bpq\" (UID: \"0f44cf0e-dff1-4976-8a7d-d04d31c5b545\") " pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" Sep 17 08:36:32.742647 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.742586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g9jl\" (UniqueName: \"kubernetes.io/projected/0f44cf0e-dff1-4976-8a7d-d04d31c5b545-kube-api-access-4g9jl\") pod \"progression-invalid-node-0-0-65bpq\" (UID: \"0f44cf0e-dff1-4976-8a7d-d04d31c5b545\") " pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" Sep 17 08:36:32.751202 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.751171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g9jl\" (UniqueName: \"kubernetes.io/projected/0f44cf0e-dff1-4976-8a7d-d04d31c5b545-kube-api-access-4g9jl\") pod \"progression-invalid-node-0-0-65bpq\" (UID: \"0f44cf0e-dff1-4976-8a7d-d04d31c5b545\") " pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" Sep 17 08:36:32.885259 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:32.885165 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" Sep 17 08:36:33.155847 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:33.155823 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq"] Sep 17 08:36:33.157915 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:36:33.157892 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f44cf0e_dff1_4976_8a7d_d04d31c5b545.slice/crio-6bd47b0b28efa2777bfe959530f9b9caf989f4ffdac782dd9af7c2a2ed5bfcd3 WatchSource:0}: Error finding container 6bd47b0b28efa2777bfe959530f9b9caf989f4ffdac782dd9af7c2a2ed5bfcd3: Status 404 returned error can't find the container with id 6bd47b0b28efa2777bfe959530f9b9caf989f4ffdac782dd9af7c2a2ed5bfcd3 Sep 17 08:36:33.217027 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:33.216828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" event={"ID":"0f44cf0e-dff1-4976-8a7d-d04d31c5b545","Type":"ContainerStarted","Data":"6bd47b0b28efa2777bfe959530f9b9caf989f4ffdac782dd9af7c2a2ed5bfcd3"} Sep 17 08:36:34.223188 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:34.223137 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" event={"ID":"0f44cf0e-dff1-4976-8a7d-d04d31c5b545","Type":"ContainerStarted","Data":"257e6c7ef33d76ffc506293d2057238db6d918b1e4a7a44fad4c567b243a695a"} Sep 17 08:36:34.223672 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:34.223275 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" Sep 17 08:36:34.241091 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:34.241042 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" podStartSLOduration=2.241026465 podStartE2EDuration="2.241026465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:36:34.240027143 +0000 UTC m=+749.707539425" watchObservedRunningTime="2026-09-17 08:36:34.241026465 +0000 UTC m=+749.708538746" Sep 17 08:36:35.225916 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:35.225875 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" Sep 17 08:36:56.259002 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:56.258955 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" podUID="0f44cf0e-dff1-4976-8a7d-d04d31c5b545" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": read tcp 10.132.0.2:49460->10.132.0.28:28080: read: connection reset by peer" Sep 17 08:36:56.320656 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:56.320610 2580 generic.go:356] "Generic (PLEG): container finished" podID="0f44cf0e-dff1-4976-8a7d-d04d31c5b545" containerID="257e6c7ef33d76ffc506293d2057238db6d918b1e4a7a44fad4c567b243a695a" exitCode=0 Sep 17 08:36:56.320791 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:56.320685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" event={"ID":"0f44cf0e-dff1-4976-8a7d-d04d31c5b545","Type":"ContainerDied","Data":"257e6c7ef33d76ffc506293d2057238db6d918b1e4a7a44fad4c567b243a695a"} Sep 17 08:36:57.453231 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:57.453209 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" Sep 17 08:36:57.547689 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:57.547651 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g9jl\" (UniqueName: \"kubernetes.io/projected/0f44cf0e-dff1-4976-8a7d-d04d31c5b545-kube-api-access-4g9jl\") pod \"0f44cf0e-dff1-4976-8a7d-d04d31c5b545\" (UID: \"0f44cf0e-dff1-4976-8a7d-d04d31c5b545\") " Sep 17 08:36:57.549817 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:57.549782 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f44cf0e-dff1-4976-8a7d-d04d31c5b545-kube-api-access-4g9jl" (OuterVolumeSpecName: "kube-api-access-4g9jl") pod "0f44cf0e-dff1-4976-8a7d-d04d31c5b545" (UID: "0f44cf0e-dff1-4976-8a7d-d04d31c5b545"). InnerVolumeSpecName "kube-api-access-4g9jl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:36:57.648430 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:57.648355 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g9jl\" (UniqueName: \"kubernetes.io/projected/0f44cf0e-dff1-4976-8a7d-d04d31c5b545-kube-api-access-4g9jl\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:36:58.331036 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:58.331006 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" Sep 17 08:36:58.331036 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:58.331032 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq" event={"ID":"0f44cf0e-dff1-4976-8a7d-d04d31c5b545","Type":"ContainerDied","Data":"6bd47b0b28efa2777bfe959530f9b9caf989f4ffdac782dd9af7c2a2ed5bfcd3"} Sep 17 08:36:58.331239 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:36:58.331070 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bd47b0b28efa2777bfe959530f9b9caf989f4ffdac782dd9af7c2a2ed5bfcd3" Sep 17 08:38:42.194865 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.194822 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5"] Sep 17 08:38:42.195448 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.195269 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f44cf0e-dff1-4976-8a7d-d04d31c5b545" containerName="node" Sep 17 08:38:42.195448 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.195289 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f44cf0e-dff1-4976-8a7d-d04d31c5b545" containerName="node" Sep 17 08:38:42.195448 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.195361 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f44cf0e-dff1-4976-8a7d-d04d31c5b545" containerName="node" Sep 17 08:38:42.198240 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.198209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" Sep 17 08:38:42.200667 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.200639 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"kube-root-ca.crt\"" Sep 17 08:38:42.200809 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.200680 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"default-dockercfg-wm27p\"" Sep 17 08:38:42.200809 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.200651 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-j9b9r\"/\"openshift-service-ca.crt\"" Sep 17 08:38:42.207439 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.207413 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5"] Sep 17 08:38:42.280143 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.280105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g25f\" (UniqueName: \"kubernetes.io/projected/93975db6-bc3a-4707-b47a-3a644f2267d7-kube-api-access-8g25f\") pod \"progression-no-metrics-node-0-0-svqv5\" (UID: \"93975db6-bc3a-4707-b47a-3a644f2267d7\") " pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" Sep 17 08:38:42.381356 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.381322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g25f\" (UniqueName: \"kubernetes.io/projected/93975db6-bc3a-4707-b47a-3a644f2267d7-kube-api-access-8g25f\") pod \"progression-no-metrics-node-0-0-svqv5\" (UID: \"93975db6-bc3a-4707-b47a-3a644f2267d7\") " pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" Sep 17 08:38:42.389459 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.389429 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g25f\" (UniqueName: \"kubernetes.io/projected/93975db6-bc3a-4707-b47a-3a644f2267d7-kube-api-access-8g25f\") pod \"progression-no-metrics-node-0-0-svqv5\" (UID: \"93975db6-bc3a-4707-b47a-3a644f2267d7\") " pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" Sep 17 08:38:42.511215 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.511143 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" Sep 17 08:38:42.780757 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:42.780736 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5"] Sep 17 08:38:42.783067 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:38:42.783039 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93975db6_bc3a_4707_b47a_3a644f2267d7.slice/crio-ec3db99036dc993b712332c3053cc1287c15a4f842b5ff4411be5844c45222dd WatchSource:0}: Error finding container ec3db99036dc993b712332c3053cc1287c15a4f842b5ff4411be5844c45222dd: Status 404 returned error can't find the container with id ec3db99036dc993b712332c3053cc1287c15a4f842b5ff4411be5844c45222dd Sep 17 08:38:43.775673 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:43.775634 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" event={"ID":"93975db6-bc3a-4707-b47a-3a644f2267d7","Type":"ContainerStarted","Data":"0402de17460874057e1fdb13cf15048ec3a35620b48758f88b424ff8a667a804"} Sep 17 08:38:43.776152 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:43.775719 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" event={"ID":"93975db6-bc3a-4707-b47a-3a644f2267d7","Type":"ContainerStarted","Data":"ec3db99036dc993b712332c3053cc1287c15a4f842b5ff4411be5844c45222dd"} Sep 17 08:38:43.793544 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:43.793481 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" podStartSLOduration=1.793465474 podStartE2EDuration="1.793465474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:38:43.792021802 +0000 UTC m=+879.259534084" watchObservedRunningTime="2026-09-17 08:38:43.793465474 +0000 UTC m=+879.260977759" Sep 17 08:38:48.799120 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:48.799088 2580 generic.go:356] "Generic (PLEG): container finished" podID="93975db6-bc3a-4707-b47a-3a644f2267d7" containerID="0402de17460874057e1fdb13cf15048ec3a35620b48758f88b424ff8a667a804" exitCode=0 Sep 17 08:38:48.799498 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:48.799161 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" event={"ID":"93975db6-bc3a-4707-b47a-3a644f2267d7","Type":"ContainerDied","Data":"0402de17460874057e1fdb13cf15048ec3a35620b48758f88b424ff8a667a804"} Sep 17 08:38:49.928489 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:49.928465 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" Sep 17 08:38:50.046673 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:50.046636 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g25f\" (UniqueName: \"kubernetes.io/projected/93975db6-bc3a-4707-b47a-3a644f2267d7-kube-api-access-8g25f\") pod \"93975db6-bc3a-4707-b47a-3a644f2267d7\" (UID: \"93975db6-bc3a-4707-b47a-3a644f2267d7\") " Sep 17 08:38:50.048807 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:50.048773 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93975db6-bc3a-4707-b47a-3a644f2267d7-kube-api-access-8g25f" (OuterVolumeSpecName: "kube-api-access-8g25f") pod "93975db6-bc3a-4707-b47a-3a644f2267d7" (UID: "93975db6-bc3a-4707-b47a-3a644f2267d7"). InnerVolumeSpecName "kube-api-access-8g25f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:38:50.147768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:50.147683 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g25f\" (UniqueName: \"kubernetes.io/projected/93975db6-bc3a-4707-b47a-3a644f2267d7-kube-api-access-8g25f\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:38:50.808868 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:50.808844 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" Sep 17 08:38:50.808868 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:50.808859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5" event={"ID":"93975db6-bc3a-4707-b47a-3a644f2267d7","Type":"ContainerDied","Data":"ec3db99036dc993b712332c3053cc1287c15a4f842b5ff4411be5844c45222dd"} Sep 17 08:38:50.809078 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:50.808934 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec3db99036dc993b712332c3053cc1287c15a4f842b5ff4411be5844c45222dd" Sep 17 08:38:52.976300 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:52.976266 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2txhn/must-gather-kx8rk"] Sep 17 08:38:52.976670 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:52.976555 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93975db6-bc3a-4707-b47a-3a644f2267d7" containerName="node" Sep 17 08:38:52.976670 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:52.976567 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="93975db6-bc3a-4707-b47a-3a644f2267d7" containerName="node" Sep 17 08:38:52.976670 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:52.976648 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="93975db6-bc3a-4707-b47a-3a644f2267d7" containerName="node" Sep 17 08:38:52.979662 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:52.979643 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:38:52.982245 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:52.982219 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2txhn\"/\"default-dockercfg-h257w\"" Sep 17 08:38:52.983207 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:52.983189 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2txhn\"/\"kube-root-ca.crt\"" Sep 17 08:38:52.983207 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:52.983202 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2txhn\"/\"openshift-service-ca.crt\"" Sep 17 08:38:52.989770 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:52.989743 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2txhn/must-gather-kx8rk"] Sep 17 08:38:53.072130 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.072100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-must-gather-output\") pod \"must-gather-kx8rk\" (UID: \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\") " pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:38:53.072283 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.072157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24mlr\" (UniqueName: \"kubernetes.io/projected/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-kube-api-access-24mlr\") pod \"must-gather-kx8rk\" (UID: \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\") " pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:38:53.173152 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.173112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-must-gather-output\") pod \"must-gather-kx8rk\" (UID: \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\") " pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:38:53.173327 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.173188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24mlr\" (UniqueName: \"kubernetes.io/projected/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-kube-api-access-24mlr\") pod \"must-gather-kx8rk\" (UID: \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\") " pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:38:53.173446 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.173427 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-must-gather-output\") pod \"must-gather-kx8rk\" (UID: \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\") " pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:38:53.182452 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.182430 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24mlr\" (UniqueName: \"kubernetes.io/projected/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-kube-api-access-24mlr\") pod \"must-gather-kx8rk\" (UID: \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\") " pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:38:53.289186 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.289110 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:38:53.558335 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.558307 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2txhn/must-gather-kx8rk"] Sep 17 08:38:53.561033 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:38:53.561009 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ba2eb67_1d5e_4f2e_96a6_7fd0efad8ef5.slice/crio-6ac7aca1e9df2117c1f31ffb455acfa26181dd37446eaf798796d34d5a80b9e8 WatchSource:0}: Error finding container 6ac7aca1e9df2117c1f31ffb455acfa26181dd37446eaf798796d34d5a80b9e8: Status 404 returned error can't find the container with id 6ac7aca1e9df2117c1f31ffb455acfa26181dd37446eaf798796d34d5a80b9e8 Sep 17 08:38:53.563212 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.563191 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 08:38:53.823765 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:53.823685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2txhn/must-gather-kx8rk" event={"ID":"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5","Type":"ContainerStarted","Data":"6ac7aca1e9df2117c1f31ffb455acfa26181dd37446eaf798796d34d5a80b9e8"} Sep 17 08:38:57.242763 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:57.242678 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m"] Sep 17 08:38:57.246351 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:57.246322 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-disabled-node-0-0-v9q2m"] Sep 17 08:38:57.251299 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:57.251273 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw"] Sep 17 08:38:57.254660 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:57.254636 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-enabled-node-0-0-kg8nw"] Sep 17 08:38:57.261714 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:57.261689 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq"] Sep 17 08:38:57.265131 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:57.265108 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-invalid-node-0-0-65bpq"] Sep 17 08:38:57.280243 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:57.280213 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5"] Sep 17 08:38:57.283725 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:57.283700 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-j9b9r/progression-no-metrics-node-0-0-svqv5"] Sep 17 08:38:59.057136 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:59.057101 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f44cf0e-dff1-4976-8a7d-d04d31c5b545" path="/var/lib/kubelet/pods/0f44cf0e-dff1-4976-8a7d-d04d31c5b545/volumes" Sep 17 08:38:59.057546 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:59.057502 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="192276f4-a29b-48b5-97e1-35f7df3c1f82" path="/var/lib/kubelet/pods/192276f4-a29b-48b5-97e1-35f7df3c1f82/volumes" Sep 17 08:38:59.057946 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:59.057923 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93975db6-bc3a-4707-b47a-3a644f2267d7" path="/var/lib/kubelet/pods/93975db6-bc3a-4707-b47a-3a644f2267d7/volumes" Sep 17 08:38:59.058288 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:59.058265 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceffd387-c3ac-462f-ba78-e0eaca3d3269" path="/var/lib/kubelet/pods/ceffd387-c3ac-462f-ba78-e0eaca3d3269/volumes" Sep 17 08:38:59.860244 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:38:59.860202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2txhn/must-gather-kx8rk" event={"ID":"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5","Type":"ContainerStarted","Data":"22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f"} Sep 17 08:39:00.867271 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:00.867235 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2txhn/must-gather-kx8rk" event={"ID":"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5","Type":"ContainerStarted","Data":"fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2"} Sep 17 08:39:00.882046 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:00.881983 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2txhn/must-gather-kx8rk" podStartSLOduration=2.751728737 podStartE2EDuration="8.881965278s" totalImagesPullingTime="6.130236541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 08:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:39:00.881721513 +0000 UTC m=+896.349233791" watchObservedRunningTime="2026-09-17 08:39:00.881965278 +0000 UTC m=+896.349477560" Sep 17 08:39:45.095325 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:45.095294 2580 generic.go:356] "Generic (PLEG): container finished" podID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" containerID="22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f" exitCode=0 Sep 17 08:39:45.095747 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:45.095369 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2txhn/must-gather-kx8rk" event={"ID":"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5","Type":"ContainerDied","Data":"22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f"} Sep 17 08:39:45.095747 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:45.095676 2580 scope.go:117] "RemoveContainer" containerID="22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f" Sep 17 08:39:45.291367 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:45.291343 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2txhn_must-gather-kx8rk_2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5/gather/0.log" Sep 17 08:39:48.541372 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:48.541338 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bn7qh_a141cbb6-0bb2-4cc8-b905-5f2cd1f28824/global-pull-secret-syncer/0.log" Sep 17 08:39:48.701765 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:48.701733 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gphn5_dab4b815-e4b7-4b19-a4c9-9ae24bd453a8/konnectivity-agent/0.log" Sep 17 08:39:48.774012 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:48.773980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-148.ec2.internal_647917f02eb3787874c757d76b3690f4/haproxy/0.log" Sep 17 08:39:50.604251 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.604215 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-2txhn/must-gather-kx8rk"] Sep 17 08:39:50.604815 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.604431 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-2txhn/must-gather-kx8rk" podUID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" containerName="copy" containerID="cri-o://fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2" gracePeriod=2 Sep 17 08:39:50.607768 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.607740 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-2txhn/must-gather-kx8rk"] Sep 17 08:39:50.840937 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.840912 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2txhn_must-gather-kx8rk_2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5/copy/0.log" Sep 17 08:39:50.843510 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.843490 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:39:50.845615 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:39:50.845591 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-kx8rk\" is forbidden: User \"system:node:ip-10-0-140-148.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2txhn\": no relationship found between node 'ip-10-0-140-148.ec2.internal' and this object" podUID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:39:50.877133 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.877067 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24mlr\" (UniqueName: \"kubernetes.io/projected/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-kube-api-access-24mlr\") pod \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\" (UID: \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\") " Sep 17 08:39:50.877133 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.877112 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-must-gather-output\") pod \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\" (UID: \"2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5\") " Sep 17 08:39:50.878440 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.878418 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" (UID: "2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 08:39:50.879393 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.879373 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-kube-api-access-24mlr" (OuterVolumeSpecName: "kube-api-access-24mlr") pod "2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" (UID: "2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5"). InnerVolumeSpecName "kube-api-access-24mlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 08:39:50.977951 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.977917 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24mlr\" (UniqueName: \"kubernetes.io/projected/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-kube-api-access-24mlr\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:39:50.977951 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:50.977946 2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5-must-gather-output\") on node \"ip-10-0-140-148.ec2.internal\" DevicePath \"\"" Sep 17 08:39:51.056645 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.056579 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" path="/var/lib/kubelet/pods/2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5/volumes" Sep 17 08:39:51.123258 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.123234 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2txhn_must-gather-kx8rk_2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5/copy/0.log" Sep 17 08:39:51.123579 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.123558 2580 generic.go:356] "Generic (PLEG): container finished" podID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" containerID="fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2" exitCode=143 Sep 17 08:39:51.123701 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.123601 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2txhn/must-gather-kx8rk" Sep 17 08:39:51.123701 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.123666 2580 scope.go:117] "RemoveContainer" containerID="fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2" Sep 17 08:39:51.131546 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.131525 2580 scope.go:117] "RemoveContainer" containerID="22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f" Sep 17 08:39:51.143512 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.143493 2580 scope.go:117] "RemoveContainer" containerID="fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2" Sep 17 08:39:51.143818 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:39:51.143796 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2\": container with ID starting with fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2 not found: ID does not exist" containerID="fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2" Sep 17 08:39:51.143896 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.143831 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2"} err="failed to get container status \"fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2\": rpc error: code = NotFound desc = could not find container \"fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2\": container with ID starting with fd338cd014ba665405c2288a98d36512d89831037edc2415a03be76b8b4fbcc2 not found: ID does not exist" Sep 17 08:39:51.143896 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.143859 2580 scope.go:117] "RemoveContainer" containerID="22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f" Sep 17 08:39:51.144119 ip-10-0-140-148 kubenswrapper[2580]: E0917 08:39:51.144100 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f\": container with ID starting with 22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f not found: ID does not exist" containerID="22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f" Sep 17 08:39:51.144156 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:51.144127 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f"} err="failed to get container status \"22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f\": rpc error: code = NotFound desc = could not find container \"22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f\": container with ID starting with 22d28cbb0a78011ec892fad98e364c42159304c7815b28a30ec646c2663a387f not found: ID does not exist" Sep 17 08:39:52.373609 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.373584 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-6qxqn_34e5fd67-3cda-4873-85e7-4df55bae9e4e/kube-state-metrics/0.log" Sep 17 08:39:52.396112 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.396086 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-6qxqn_34e5fd67-3cda-4873-85e7-4df55bae9e4e/kube-rbac-proxy-main/0.log" Sep 17 08:39:52.421877 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.421850 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-6qxqn_34e5fd67-3cda-4873-85e7-4df55bae9e4e/kube-rbac-proxy-self/0.log" Sep 17 08:39:52.468983 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.468910 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-99b4cdcbf-hscx4_922ed2eb-6779-424c-94e3-6160667139be/metrics-server/0.log" Sep 17 08:39:52.547018 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.546992 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6v95x_8789481a-50e3-47d6-8f93-2689fbb7b6f0/node-exporter/0.log" Sep 17 08:39:52.567126 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.567098 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6v95x_8789481a-50e3-47d6-8f93-2689fbb7b6f0/kube-rbac-proxy/0.log" Sep 17 08:39:52.587191 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.587168 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6v95x_8789481a-50e3-47d6-8f93-2689fbb7b6f0/init-textfile/0.log" Sep 17 08:39:52.770684 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.770651 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jpv9q_277fe07c-d1ca-4c36-b0e3-e929d06cb6a5/kube-rbac-proxy-main/0.log" Sep 17 08:39:52.791782 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.791758 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jpv9q_277fe07c-d1ca-4c36-b0e3-e929d06cb6a5/kube-rbac-proxy-self/0.log" Sep 17 08:39:52.815019 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.814994 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jpv9q_277fe07c-d1ca-4c36-b0e3-e929d06cb6a5/openshift-state-metrics/0.log" Sep 17 08:39:52.850536 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.850508 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21388a6f-3783-4bc5-9312-6e9d7ed3dd33/prometheus/0.log" Sep 17 08:39:52.872345 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.872318 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21388a6f-3783-4bc5-9312-6e9d7ed3dd33/config-reloader/0.log" Sep 17 08:39:52.893984 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.893959 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21388a6f-3783-4bc5-9312-6e9d7ed3dd33/thanos-sidecar/0.log" Sep 17 08:39:52.913736 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.913711 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21388a6f-3783-4bc5-9312-6e9d7ed3dd33/kube-rbac-proxy-web/0.log" Sep 17 08:39:52.934308 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.934290 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21388a6f-3783-4bc5-9312-6e9d7ed3dd33/kube-rbac-proxy/0.log" Sep 17 08:39:52.953893 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.953871 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21388a6f-3783-4bc5-9312-6e9d7ed3dd33/kube-rbac-proxy-thanos/0.log" Sep 17 08:39:52.976447 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:52.976420 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_21388a6f-3783-4bc5-9312-6e9d7ed3dd33/init-config-reloader/0.log" Sep 17 08:39:53.055569 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:53.055544 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-nvkbz_39b52a79-b6b6-4378-9a4c-08dfc6d0f7d4/prometheus-operator-admission-webhook/0.log" Sep 17 08:39:55.515954 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.515924 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-6kpmz_0b3cb928-4e76-4ce2-9406-f25102090879/download-server/0.log" Sep 17 08:39:55.970964 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.970744 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr"] Sep 17 08:39:55.971425 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.971402 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" containerName="gather" Sep 17 08:39:55.971535 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.971428 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" containerName="gather" Sep 17 08:39:55.971535 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.971460 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" containerName="copy" Sep 17 08:39:55.971535 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.971469 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" containerName="copy" Sep 17 08:39:55.971705 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.971657 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" containerName="gather" Sep 17 08:39:55.971705 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.971671 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ba2eb67-1d5e-4f2e-96a6-7fd0efad8ef5" containerName="copy" Sep 17 08:39:55.975590 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.975567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:55.978022 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.977999 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qstw9\"/\"openshift-service-ca.crt\"" Sep 17 08:39:55.978165 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.978139 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qstw9\"/\"kube-root-ca.crt\"" Sep 17 08:39:55.979049 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.979033 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qstw9\"/\"default-dockercfg-qtpq4\"" Sep 17 08:39:55.982107 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:55.982085 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr"] Sep 17 08:39:56.010709 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.010680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj2jr\" (UniqueName: \"kubernetes.io/projected/abc309ec-c017-4483-82a8-c3123c683f48-kube-api-access-zj2jr\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.010842 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.010727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-sys\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.010842 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.010749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-proc\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.010842 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.010782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-lib-modules\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.010842 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.010811 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-podres\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.027287 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.027264 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-8qr4f_ac9d2ed0-2819-45e4-92fb-c67c6260f6d0/volume-data-source-validator/0.log" Sep 17 08:39:56.111703 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.111669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-lib-modules\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.111884 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.111711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-podres\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.111884 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.111857 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-lib-modules\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.111884 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.111868 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-podres\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.112050 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.111915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj2jr\" (UniqueName: \"kubernetes.io/projected/abc309ec-c017-4483-82a8-c3123c683f48-kube-api-access-zj2jr\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.112050 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.111974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-sys\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.112050 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.112014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-proc\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.112210 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.112057 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-sys\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.112210 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.112069 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/abc309ec-c017-4483-82a8-c3123c683f48-proc\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.120028 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.119993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj2jr\" (UniqueName: \"kubernetes.io/projected/abc309ec-c017-4483-82a8-c3123c683f48-kube-api-access-zj2jr\") pod \"perf-node-gather-daemonset-fjrdr\" (UID: \"abc309ec-c017-4483-82a8-c3123c683f48\") " pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.286804 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.286718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:56.555293 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.555267 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr"] Sep 17 08:39:56.558004 ip-10-0-140-148 kubenswrapper[2580]: W0917 08:39:56.557978 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podabc309ec_c017_4483_82a8_c3123c683f48.slice/crio-49adac1a0f16520e6e1b5ef7bce720d231ae101365cf606698dad9c921845bbb WatchSource:0}: Error finding container 49adac1a0f16520e6e1b5ef7bce720d231ae101365cf606698dad9c921845bbb: Status 404 returned error can't find the container with id 49adac1a0f16520e6e1b5ef7bce720d231ae101365cf606698dad9c921845bbb Sep 17 08:39:56.835140 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.835064 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dlqhq_50a808da-fe8f-434a-be74-e7ac5abaf4fe/dns/0.log" Sep 17 08:39:56.853445 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.853413 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dlqhq_50a808da-fe8f-434a-be74-e7ac5abaf4fe/kube-rbac-proxy/0.log" Sep 17 08:39:56.951287 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:56.951250 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6dks4_179a10c1-4d7a-4055-aace-6dec464d4097/dns-node-resolver/0.log" Sep 17 08:39:57.153384 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:57.153298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" event={"ID":"abc309ec-c017-4483-82a8-c3123c683f48","Type":"ContainerStarted","Data":"95039eaec3679388bd3bcf5010b4845e5d8c2b25cd05bf5ca1f4574246e760c8"} Sep 17 08:39:57.153384 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:57.153345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" event={"ID":"abc309ec-c017-4483-82a8-c3123c683f48","Type":"ContainerStarted","Data":"49adac1a0f16520e6e1b5ef7bce720d231ae101365cf606698dad9c921845bbb"} Sep 17 08:39:57.153648 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:57.153385 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:39:57.169615 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:57.169566 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" podStartSLOduration=2.169550604 podStartE2EDuration="2.169550604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 08:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 08:39:57.167940743 +0000 UTC m=+952.635453026" watchObservedRunningTime="2026-09-17 08:39:57.169550604 +0000 UTC m=+952.637062863" Sep 17 08:39:57.391495 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:57.391463 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9r77w_76fa79c8-f383-45bb-8f79-31a592ed0239/node-ca/0.log" Sep 17 08:39:58.399385 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:58.399352 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bp954_1e53d483-78b4-4663-bd41-2efdef4ad6fe/serve-healthcheck-canary/0.log" Sep 17 08:39:58.866656 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:58.866608 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqzl6_cc9417f1-af51-495e-acb4-cb4f04d6bcc3/kube-rbac-proxy/0.log" Sep 17 08:39:58.885647 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:58.885610 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqzl6_cc9417f1-af51-495e-acb4-cb4f04d6bcc3/exporter/0.log" Sep 17 08:39:58.905024 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:39:58.905000 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqzl6_cc9417f1-af51-495e-acb4-cb4f04d6bcc3/extractor/0.log" Sep 17 08:40:03.167830 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:03.167792 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qstw9/perf-node-gather-daemonset-fjrdr" Sep 17 08:40:03.618693 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:03.618666 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-cmsqf_83dbc355-a763-4998-b8d7-cdf9c401ac5b/migrator/0.log" Sep 17 08:40:03.638137 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:03.638108 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-cmsqf_83dbc355-a763-4998-b8d7-cdf9c401ac5b/graceful-termination/0.log" Sep 17 08:40:05.077223 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.077199 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c6bjp_544118fc-af72-4f25-aeb3-6f43c91e993e/kube-multus-additional-cni-plugins/0.log" Sep 17 08:40:05.097979 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.097956 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c6bjp_544118fc-af72-4f25-aeb3-6f43c91e993e/egress-router-binary-copy/0.log" Sep 17 08:40:05.119300 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.119271 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c6bjp_544118fc-af72-4f25-aeb3-6f43c91e993e/cni-plugins/0.log" Sep 17 08:40:05.138413 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.138376 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c6bjp_544118fc-af72-4f25-aeb3-6f43c91e993e/bond-cni-plugin/0.log" Sep 17 08:40:05.162901 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.162877 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c6bjp_544118fc-af72-4f25-aeb3-6f43c91e993e/routeoverride-cni/0.log" Sep 17 08:40:05.182526 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.182505 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c6bjp_544118fc-af72-4f25-aeb3-6f43c91e993e/whereabouts-cni-bincopy/0.log" Sep 17 08:40:05.201533 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.201512 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c6bjp_544118fc-af72-4f25-aeb3-6f43c91e993e/whereabouts-cni/0.log" Sep 17 08:40:05.439193 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.439167 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gzg8r_2c5d3c9f-7170-4012-8f1c-e2f0e05e9ab1/kube-multus/0.log" Sep 17 08:40:05.553550 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.553512 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xjrm2_edc69206-7d0f-4086-964c-77facc99d777/network-metrics-daemon/0.log" Sep 17 08:40:05.572565 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:05.572532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xjrm2_edc69206-7d0f-4086-964c-77facc99d777/kube-rbac-proxy/0.log" Sep 17 08:40:06.653254 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:06.653229 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbwwd_b64902d3-2e97-4fa9-b338-e20f0b864036/ovn-controller/0.log" Sep 17 08:40:06.670272 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:06.670244 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbwwd_b64902d3-2e97-4fa9-b338-e20f0b864036/ovn-acl-logging/0.log" Sep 17 08:40:06.697846 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:06.697821 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbwwd_b64902d3-2e97-4fa9-b338-e20f0b864036/kube-rbac-proxy-node/0.log" Sep 17 08:40:06.717730 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:06.717708 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbwwd_b64902d3-2e97-4fa9-b338-e20f0b864036/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 08:40:06.737122 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:06.737101 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbwwd_b64902d3-2e97-4fa9-b338-e20f0b864036/northd/0.log" Sep 17 08:40:06.756880 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:06.756853 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbwwd_b64902d3-2e97-4fa9-b338-e20f0b864036/nbdb/0.log" Sep 17 08:40:06.777586 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:06.777558 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbwwd_b64902d3-2e97-4fa9-b338-e20f0b864036/sbdb/0.log" Sep 17 08:40:06.828927 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:06.828903 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbwwd_b64902d3-2e97-4fa9-b338-e20f0b864036/ovnkube-controller/0.log" Sep 17 08:40:07.747769 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:07.747728 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-z6jr4_bdd47568-8625-48a7-976f-2da66bd80738/check-endpoints/0.log" Sep 17 08:40:07.813677 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:07.813603 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q4gsh_fd354192-24d2-4e8f-a7f7-f9c0c7c0d839/network-check-target-container/0.log" Sep 17 08:40:08.671298 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:08.671270 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-sx2lz_6f15278e-dac9-4be3-9d3b-e09d5b36fb6a/iptables-alerter/0.log" Sep 17 08:40:09.313869 ip-10-0-140-148 kubenswrapper[2580]: I0917 08:40:09.313838 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-92xqx_5e248508-31ae-4055-9d00-3359ff5d67dc/tuned/0.log"