Sep 16 08:55:19.120848 ip-10-0-141-124 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 16 08:55:19.120859 ip-10-0-141-124 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 16 08:55:19.120866 ip-10-0-141-124 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 16 08:55:19.121022 ip-10-0-141-124 systemd[1]: Failed to start Kubernetes Kubelet. Sep 16 08:55:29.329213 ip-10-0-141-124 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 16 08:55:29.329234 ip-10-0-141-124 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7c64df045ef54d94aadca5ec298b8ea3 -- Sep 16 08:57:23.300199 ip-10-0-141-124 systemd[1]: Starting Kubernetes Kubelet... Sep 16 08:57:23.692423 ip-10-0-141-124 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 08:57:23.692423 ip-10-0-141-124 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 16 08:57:23.692423 ip-10-0-141-124 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 08:57:23.692423 ip-10-0-141-124 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 16 08:57:23.692423 ip-10-0-141-124 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 16 08:57:23.693251 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.693148 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 16 08:57:23.703042 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703015 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 08:57:23.703042 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703034 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 08:57:23.703042 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703038 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 08:57:23.703042 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703042 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 08:57:23.703042 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703045 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 08:57:23.703042 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703047 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 08:57:23.703042 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703051 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 08:57:23.703042 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703053 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 08:57:23.703042 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703056 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703059 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703062 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703065 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703069 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703072 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703075 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703078 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703081 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703083 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703086 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703089 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703091 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703094 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703097 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703099 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703103 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703107 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703113 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703117 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 08:57:23.703357 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703119 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703122 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703125 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703128 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703131 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703133 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703136 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703138 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703141 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703143 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703146 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703149 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703151 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703154 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703157 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703160 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703163 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703166 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703168 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703171 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 08:57:23.703838 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703173 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703176 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703179 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703183 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703185 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703188 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703190 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703193 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703198 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703202 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703205 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703208 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703211 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703214 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703217 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703219 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703222 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703224 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703227 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703229 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 08:57:23.704386 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703232 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703234 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703237 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703240 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703243 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703247 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703252 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703255 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703258 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703261 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703264 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703267 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703270 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703272 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703275 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703279 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703281 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703284 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703286 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 08:57:23.704984 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703289 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703291 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703294 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703297 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703299 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703302 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703304 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703307 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703310 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703312 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703315 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.703318 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704064 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704072 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704075 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704078 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704080 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704084 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704086 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704090 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 08:57:23.705460 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704092 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704095 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704098 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704100 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704103 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704105 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704108 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704110 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704113 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704135 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704139 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704142 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704145 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704149 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704153 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704156 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704159 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704163 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704165 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704168 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 08:57:23.705955 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704171 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704174 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704177 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704179 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704182 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704184 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704187 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704189 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704192 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704195 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704197 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704201 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704204 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704206 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704209 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704211 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704214 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704216 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704219 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 08:57:23.706468 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704222 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704224 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704227 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704230 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704233 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704237 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704240 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704242 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704245 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704247 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704251 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704255 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704257 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704261 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704264 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704267 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704269 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704272 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704274 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704278 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 08:57:23.706958 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704281 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704284 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704287 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704291 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704295 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704297 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704300 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704303 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704306 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704309 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704311 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704314 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704316 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704318 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704321 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704324 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704326 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704329 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704331 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 08:57:23.707486 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704334 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704336 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704339 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704341 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704344 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704346 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704348 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704351 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704354 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704357 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704362 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704365 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704368 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704737 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704741 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704744 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704748 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704750 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704753 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704756 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 08:57:23.707959 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704758 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704761 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704764 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704767 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704769 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704772 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704775 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704777 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704780 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704783 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704786 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704789 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704791 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704794 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704796 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704799 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704802 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704804 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704807 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704809 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 08:57:23.708452 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704812 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704815 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704820 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704822 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704825 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704827 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704830 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704833 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704835 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704838 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704840 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704843 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704846 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704848 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704851 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704853 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704856 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704858 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704878 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704880 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 08:57:23.708957 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704883 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704886 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704889 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704892 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704895 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704898 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704901 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704903 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704906 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704909 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704911 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704914 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704918 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704921 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704925 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704930 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704934 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704937 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704941 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 08:57:23.709447 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704944 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704948 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704950 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704953 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704955 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704958 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704961 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704963 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704966 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704968 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704971 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704973 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704976 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704978 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704981 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704983 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704987 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704989 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704992 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704995 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 08:57:23.709924 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.704997 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705000 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705002 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705005 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705007 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705011 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705014 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705018 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705020 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705023 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705026 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705028 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705031 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705102 2564 flags.go:64] FLAG: --address="0.0.0.0" Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705140 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705152 2564 flags.go:64] FLAG: --anonymous-auth="true" Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705156 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705160 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705163 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705167 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705171 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 16 08:57:23.710409 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705175 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705178 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705181 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705185 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705188 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705191 2564 flags.go:64] FLAG: --cgroup-root="" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705194 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705197 2564 flags.go:64] FLAG: --client-ca-file="" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705200 2564 flags.go:64] FLAG: --cloud-provider="external" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705203 2564 flags.go:64] FLAG: --cluster-dns="[]" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705207 2564 flags.go:64] FLAG: --cluster-domain="" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705210 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705213 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705216 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705220 2564 flags.go:64] FLAG: --container-log-max-files="5" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705223 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705228 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705231 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705234 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705237 2564 flags.go:64] FLAG: --contention-profiling="false" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705240 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705243 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705247 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705250 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 16 08:57:23.710933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705254 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705258 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705261 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705263 2564 flags.go:64] FLAG: --enable-load-reader="false" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705266 2564 flags.go:64] FLAG: --enable-server="true" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705270 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705274 2564 flags.go:64] FLAG: --event-burst="100" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705277 2564 flags.go:64] FLAG: --event-qps="50" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705280 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705283 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705286 2564 flags.go:64] FLAG: --eviction-hard="" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705290 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705293 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705296 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705300 2564 flags.go:64] FLAG: --eviction-soft="" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705303 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705305 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705309 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705312 2564 flags.go:64] FLAG: --experimental-mounter-path="" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705315 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705318 2564 flags.go:64] FLAG: --fail-swap-on="true" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705320 2564 flags.go:64] FLAG: --feature-gates="" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705324 2564 flags.go:64] FLAG: --file-check-frequency="20s" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705327 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705332 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 16 08:57:23.711518 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705335 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705339 2564 flags.go:64] FLAG: --healthz-port="10248" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705342 2564 flags.go:64] FLAG: --help="false" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705345 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-141-124.ec2.internal" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705348 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705351 2564 flags.go:64] FLAG: --http-check-frequency="20s" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705354 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705358 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705362 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705365 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705367 2564 flags.go:64] FLAG: --image-service-endpoint="" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705370 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705373 2564 flags.go:64] FLAG: --kube-api-burst="100" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705375 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705379 2564 flags.go:64] FLAG: --kube-api-qps="50" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705382 2564 flags.go:64] FLAG: --kube-reserved="" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705384 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705387 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705390 2564 flags.go:64] FLAG: --kubelet-cgroups="" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705393 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705396 2564 flags.go:64] FLAG: --lock-file="" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705399 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705402 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705404 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 16 08:57:23.712162 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705422 2564 flags.go:64] FLAG: --log-json-split-stream="false" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705426 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705429 2564 flags.go:64] FLAG: --log-text-split-stream="false" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705431 2564 flags.go:64] FLAG: --logging-format="text" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705434 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705437 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705441 2564 flags.go:64] FLAG: --manifest-url="" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705445 2564 flags.go:64] FLAG: --manifest-url-header="" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705449 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705452 2564 flags.go:64] FLAG: --max-open-files="1000000" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705456 2564 flags.go:64] FLAG: --max-pods="110" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705459 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705462 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705465 2564 flags.go:64] FLAG: --memory-manager-policy="None" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705468 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705471 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705475 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705478 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705485 2564 flags.go:64] FLAG: --node-status-max-images="50" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705488 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705491 2564 flags.go:64] FLAG: --oom-score-adj="-999" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705495 2564 flags.go:64] FLAG: --pod-cidr="" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705497 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 16 08:57:23.712740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705504 2564 flags.go:64] FLAG: --pod-manifest-path="" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705506 2564 flags.go:64] FLAG: --pod-max-pids="-1" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705509 2564 flags.go:64] FLAG: --pods-per-core="0" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705512 2564 flags.go:64] FLAG: --port="10250" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705515 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705519 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00478738f16fea52e" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705522 2564 flags.go:64] FLAG: --qos-reserved="" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705525 2564 flags.go:64] FLAG: --read-only-port="10255" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705528 2564 flags.go:64] FLAG: --register-node="true" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705530 2564 flags.go:64] FLAG: --register-with-taints="" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705534 2564 flags.go:64] FLAG: --registry-burst="10" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705542 2564 flags.go:64] FLAG: --registry-qps="5" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705545 2564 flags.go:64] FLAG: --reserved-cpus="" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705548 2564 flags.go:64] FLAG: --reserved-memory="" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705551 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705554 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705559 2564 flags.go:64] FLAG: --rotate-certificates="false" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705562 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705564 2564 flags.go:64] FLAG: --runonce="false" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705568 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705571 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705574 2564 flags.go:64] FLAG: --seccomp-default="false" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705577 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705580 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705583 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705587 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 16 08:57:23.713338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705590 2564 flags.go:64] FLAG: --storage-driver-password="root" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705593 2564 flags.go:64] FLAG: --storage-driver-secure="false" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705596 2564 flags.go:64] FLAG: --storage-driver-table="stats" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705599 2564 flags.go:64] FLAG: --storage-driver-user="root" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705601 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705604 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705608 2564 flags.go:64] FLAG: --system-cgroups="" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705611 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705616 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705619 2564 flags.go:64] FLAG: --tls-cert-file="" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705622 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705626 2564 flags.go:64] FLAG: --tls-min-version="" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705628 2564 flags.go:64] FLAG: --tls-private-key-file="" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705631 2564 flags.go:64] FLAG: --topology-manager-policy="none" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705634 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705637 2564 flags.go:64] FLAG: --topology-manager-scope="container" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705640 2564 flags.go:64] FLAG: --v="2" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705644 2564 flags.go:64] FLAG: --version="false" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705648 2564 flags.go:64] FLAG: --vmodule="" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705652 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.705655 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705776 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705780 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705783 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 08:57:23.713999 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705786 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705790 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705794 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705796 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705799 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705801 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705804 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705806 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705810 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705814 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705817 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705820 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705823 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705827 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705831 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705834 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705838 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705840 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705843 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 08:57:23.714581 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705846 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705848 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705851 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705854 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705857 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705859 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705876 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705879 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705882 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705885 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705888 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705892 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705894 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705897 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705901 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705904 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705906 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705909 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705912 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705914 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 08:57:23.715113 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705917 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705920 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705922 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705925 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705928 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705930 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705933 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705936 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705938 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705941 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705943 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705946 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705949 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705951 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705954 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705957 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705959 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705962 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705965 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705968 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 08:57:23.715605 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705970 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705973 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705976 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705980 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705983 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705985 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705989 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705992 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705994 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.705997 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706000 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706002 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706005 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706007 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706010 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706013 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706015 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706018 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706020 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706023 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 08:57:23.716104 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706025 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706028 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706031 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706034 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706037 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706039 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706042 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706044 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706047 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706049 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706052 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706055 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706057 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706060 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706063 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706066 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 08:57:23.716652 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.706069 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.706618 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.713509 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.713527 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.714194 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.714202 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714261 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714266 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714269 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714272 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714275 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714278 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714281 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714283 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714286 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 08:57:23.717061 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714289 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714291 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714294 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714297 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714300 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714302 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714306 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714309 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714311 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714314 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714316 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714319 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714323 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714326 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714329 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714334 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714337 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714340 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714343 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 08:57:23.717432 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714346 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714350 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714354 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714356 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714359 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714362 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714364 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714367 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714370 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714372 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714375 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714378 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714381 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714383 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714386 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714389 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714391 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714394 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714397 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714399 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 08:57:23.717917 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714402 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714405 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714407 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714410 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714412 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714415 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714418 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714421 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714423 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714426 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714429 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714431 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714434 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714438 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714441 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714443 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714446 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714449 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714451 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 08:57:23.718416 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714454 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714456 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714459 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714461 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714464 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714467 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714471 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714474 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714477 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714480 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714483 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714486 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714489 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714492 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714495 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714498 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714501 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714504 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714507 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 08:57:23.718927 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714510 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714512 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714515 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714518 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714520 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714523 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714526 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714529 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714532 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714535 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714538 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714541 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714543 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.714548 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714661 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 16 08:57:23.719412 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714665 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714668 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714671 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714675 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714678 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714681 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714684 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714686 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714690 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714694 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714697 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714700 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714703 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714705 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714708 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714711 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714713 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714716 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714718 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714721 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 16 08:57:23.719821 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714724 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714726 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714729 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714732 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714735 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714737 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714740 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714743 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714746 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714749 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714751 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714754 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714756 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714759 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714761 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714764 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714767 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714771 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714774 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 16 08:57:23.720337 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714777 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714780 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714783 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714786 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714789 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714792 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714794 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714798 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714801 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714803 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714806 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714809 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714812 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714815 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714817 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714820 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714822 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714825 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714828 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714830 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 16 08:57:23.720808 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714833 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714836 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714839 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714842 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714846 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714849 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714852 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714854 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714857 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714874 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714878 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714881 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714883 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714886 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714889 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714891 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714894 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714896 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714899 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714902 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 16 08:57:23.721303 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714905 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714907 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714910 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714913 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714915 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714918 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714920 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714923 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714925 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714928 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714930 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714933 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714935 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714938 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714941 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714952 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714955 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714958 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 16 08:57:23.721826 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:23.714961 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 16 08:57:23.722284 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.714966 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 16 08:57:23.722284 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.715084 2564 server.go:962] "Client rotation is on, will bootstrap in background" Sep 16 08:57:23.722284 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.717093 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 16 08:57:23.722284 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.718003 2564 server.go:1019] "Starting client certificate rotation" Sep 16 08:57:23.722284 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.718101 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 08:57:23.722284 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.718136 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 16 08:57:23.722284 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.720217 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 08:57:23.723334 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.723313 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 16 08:57:23.733185 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.733167 2564 log.go:25] "Validated CRI v1 runtime API" Sep 16 08:57:23.736551 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.736535 2564 log.go:25] "Validated CRI v1 image API" Sep 16 08:57:23.737426 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.737409 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 16 08:57:23.742583 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.742444 2564 fs.go:135] Filesystem UUIDs: map[002e345c-e877-424a-817e-948824269a49:/dev/nvme0n1p3 48d2ff0b-a377-4e4d-83f3-d9f5d0c89507:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 16 08:57:23.742667 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.742576 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 16 08:57:23.744932 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.744913 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 08:57:23.747723 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.747604 2564 manager.go:216] Machine: {Timestamp:2026-09-16 08:57:23.746429597 +0000 UTC m=+0.334191182 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204343 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f6e334876d5c51d41fce32b63d95f SystemUUID:ec2f6e33-4876-d5c5-1d41-fce32b63d95f BootID:7c64df04-5ef5-4d94-aadc-a5ec298b8ea3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e3:5b:29:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e3:5b:29:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:3a:f6:c2:28:e0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 16 08:57:23.747723 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.747714 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 16 08:57:23.747900 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.747821 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 16 08:57:23.750620 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.750593 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 16 08:57:23.750804 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.750622 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 16 08:57:23.751880 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.751855 2564 topology_manager.go:138] "Creating topology manager with none policy" Sep 16 08:57:23.751938 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.751886 2564 container_manager_linux.go:309] "Creating device plugin manager" Sep 16 08:57:23.751938 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.751897 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 08:57:23.752516 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.752503 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 16 08:57:23.753235 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.753224 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 16 08:57:23.756720 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.756706 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 16 08:57:23.756855 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.756844 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 16 08:57:23.756972 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.756962 2564 kubelet.go:486] "Attempting to sync node with API server" Sep 16 08:57:23.757030 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.756983 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 16 08:57:23.757030 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.757004 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 16 08:57:23.757030 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.757017 2564 kubelet.go:398] "Adding apiserver pod source" Sep 16 08:57:23.757030 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.757030 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 16 08:57:23.757404 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.757391 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 08:57:23.757464 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.757414 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 16 08:57:23.759897 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.759882 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 16 08:57:23.761938 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.761924 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 16 08:57:23.761999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.761954 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 16 08:57:23.763974 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.763961 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 16 08:57:23.764019 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.763981 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 16 08:57:23.764019 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.763988 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 16 08:57:23.764019 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.763993 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 16 08:57:23.764019 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764002 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 16 08:57:23.764019 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764008 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 16 08:57:23.764019 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764021 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 16 08:57:23.764180 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764026 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 16 08:57:23.764180 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764033 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 16 08:57:23.764180 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764039 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 16 08:57:23.764180 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764047 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 16 08:57:23.764180 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764052 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 16 08:57:23.764669 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764658 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 16 08:57:23.764669 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.764667 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 16 08:57:23.767267 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.767242 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 16 08:57:23.767345 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.767266 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 16 08:57:23.767345 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.767275 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 16 08:57:23.768894 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.767968 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kgt5x" Sep 16 08:57:23.768975 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.768968 2564 server.go:1268] "Started kubelet" Sep 16 08:57:23.769219 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.769190 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 16 08:57:23.769282 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.769194 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 16 08:57:23.769789 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.769765 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 16 08:57:23.770238 ip-10-0-141-124 systemd[1]: Started Kubernetes Kubelet. Sep 16 08:57:23.770857 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.770839 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 16 08:57:23.772500 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.772486 2564 server.go:310] "Adding debug handlers to kubelet server" Sep 16 08:57:23.775096 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.775078 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kgt5x" Sep 16 08:57:23.775603 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.775574 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 16 08:57:23.777018 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.776138 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-124.ec2.internal.18d5c15fb5fca1e7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-124.ec2.internal,UID:ip-10-0-141-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-124.ec2.internal,},FirstTimestamp:2026-09-16 08:57:23.768926695 +0000 UTC m=+0.356688281,LastTimestamp:2026-09-16 08:57:23.768926695 +0000 UTC m=+0.356688281,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-124.ec2.internal,}" Sep 16 08:57:23.777744 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.777723 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 16 08:57:23.778178 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.778167 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 16 08:57:23.778464 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.778441 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:23.778902 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.778854 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 16 08:57:23.778902 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.778902 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 16 08:57:23.779055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.778917 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 16 08:57:23.779055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.778953 2564 factory.go:55] Registering systemd factory Sep 16 08:57:23.779055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.778967 2564 factory.go:223] Registration of the systemd container factory successfully Sep 16 08:57:23.779055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.779027 2564 reconstruct.go:97] "Volume reconstruction finished" Sep 16 08:57:23.779055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.779038 2564 reconciler.go:29] "Reconciler: start to sync state" Sep 16 08:57:23.779459 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.779444 2564 factory.go:153] Registering CRI-O factory Sep 16 08:57:23.779459 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.779461 2564 factory.go:223] Registration of the crio container factory successfully Sep 16 08:57:23.779572 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.779513 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 16 08:57:23.779572 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.779530 2564 factory.go:103] Registering Raw factory Sep 16 08:57:23.779572 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.779543 2564 manager.go:1196] Started watching for new ooms in manager Sep 16 08:57:23.781014 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.781000 2564 manager.go:349] Starting recovery of all containers Sep 16 08:57:23.786225 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.786199 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 08:57:23.789620 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.789335 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-124.ec2.internal\" not found" node="ip-10-0-141-124.ec2.internal" Sep 16 08:57:23.791255 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.791236 2564 manager.go:354] Recovery completed Sep 16 08:57:23.795783 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.795713 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 08:57:23.797527 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.797508 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 16 08:57:23.797588 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.797535 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 08:57:23.797588 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.797549 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 16 08:57:23.798894 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.798847 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 16 08:57:23.798894 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.798878 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 16 08:57:23.799044 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.798899 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 16 08:57:23.799044 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.798909 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 08:57:23.800289 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.800271 2564 policy_none.go:49] "None policy: Start" Sep 16 08:57:23.800361 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.800300 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 16 08:57:23.800361 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.800326 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 16 08:57:23.801389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.801368 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 16 08:57:23.801468 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.801405 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 08:57:23.801468 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.801419 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 16 08:57:23.801791 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.801776 2564 policy_none.go:47] "Start" Sep 16 08:57:23.823510 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.823495 2564 manager.go:337] "Starting Device Plugin manager" Sep 16 08:57:23.844536 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.823537 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 16 08:57:23.844536 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.823549 2564 server.go:87] "Starting device plugin registration server" Sep 16 08:57:23.844536 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.823896 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 16 08:57:23.844536 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.823910 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 16 08:57:23.844536 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.824008 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 16 08:57:23.844536 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.824083 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 16 08:57:23.844536 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.824092 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 16 08:57:23.844536 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.825324 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 16 08:57:23.844536 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.825372 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:23.909126 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.909094 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 16 08:57:23.910314 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.910298 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 16 08:57:23.910378 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.910356 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 16 08:57:23.910419 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.910385 2564 kubelet.go:2448] "Starting kubelet main sync loop" Sep 16 08:57:23.910469 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.910431 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 16 08:57:23.912564 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.912547 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 08:57:23.924285 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.924269 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 08:57:23.925141 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.925125 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 16 08:57:23.925224 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.925160 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 08:57:23.925224 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.925177 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 16 08:57:23.925224 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.925209 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-124.ec2.internal" Sep 16 08:57:23.932644 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:23.932625 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-124.ec2.internal" Sep 16 08:57:23.932743 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.932647 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-124.ec2.internal\": node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:23.943238 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:23.943155 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:24.011288 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.011249 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal"] Sep 16 08:57:24.011420 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.011351 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 08:57:24.012450 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.012432 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 16 08:57:24.012524 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.012464 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 08:57:24.012524 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.012479 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 16 08:57:24.014793 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.014780 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 08:57:24.014937 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.014925 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.014981 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.014961 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 08:57:24.015562 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.015545 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 16 08:57:24.015654 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.015575 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 08:57:24.015654 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.015545 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 16 08:57:24.015654 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.015588 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 16 08:57:24.015654 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.015607 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 08:57:24.015654 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.015618 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 16 08:57:24.017706 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.017689 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.017789 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.017714 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 16 08:57:24.018386 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.018371 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientMemory" Sep 16 08:57:24.018475 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.018407 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasNoDiskPressure" Sep 16 08:57:24.018475 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.018424 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeHasSufficientPID" Sep 16 08:57:24.038436 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.038410 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-124.ec2.internal\" not found" node="ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.041856 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.041841 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-124.ec2.internal\" not found" node="ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.043890 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.043875 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:24.081193 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.081165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22de053db9641afe6104c22d09ccaea9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"22de053db9641afe6104c22d09ccaea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.081193 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.081195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22de053db9641afe6104c22d09ccaea9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"22de053db9641afe6104c22d09ccaea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.081324 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.081210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e504b6ddcb0faa30a582965ff580b686-config\") pod \"kube-apiserver-proxy-ip-10-0-141-124.ec2.internal\" (UID: \"e504b6ddcb0faa30a582965ff580b686\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.144461 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.144428 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:24.181900 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.181875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22de053db9641afe6104c22d09ccaea9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"22de053db9641afe6104c22d09ccaea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.181985 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.181904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22de053db9641afe6104c22d09ccaea9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"22de053db9641afe6104c22d09ccaea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.181985 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.181944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e504b6ddcb0faa30a582965ff580b686-config\") pod \"kube-apiserver-proxy-ip-10-0-141-124.ec2.internal\" (UID: \"e504b6ddcb0faa30a582965ff580b686\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.182045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.182018 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e504b6ddcb0faa30a582965ff580b686-config\") pod \"kube-apiserver-proxy-ip-10-0-141-124.ec2.internal\" (UID: \"e504b6ddcb0faa30a582965ff580b686\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.182045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.182030 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22de053db9641afe6104c22d09ccaea9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"22de053db9641afe6104c22d09ccaea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.182110 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.182073 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22de053db9641afe6104c22d09ccaea9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal\" (UID: \"22de053db9641afe6104c22d09ccaea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.245196 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.245132 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:24.340751 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.340712 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.345575 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.345471 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:24.345575 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.345508 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.446950 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.446905 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:24.551225 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.551137 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:24.653926 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.653857 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-124.ec2.internal\" not found" Sep 16 08:57:24.676389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.676364 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 08:57:24.679413 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.679395 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.693205 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.693187 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 08:57:24.694857 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.694838 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" Sep 16 08:57:24.705617 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.705596 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 16 08:57:24.717614 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.717593 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 16 08:57:24.717762 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.717735 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 08:57:24.717825 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.717735 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 08:57:24.717825 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.717760 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 16 08:57:24.757155 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.757131 2564 apiserver.go:52] "Watching apiserver" Sep 16 08:57:24.776232 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.776207 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 16 08:57:24.778397 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.777317 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-t4hbk","openshift-network-diagnostics/network-check-target-j6g7d","openshift-network-operator/iptables-alerter-tgv55","openshift-ovn-kubernetes/ovnkube-node-vtwpg","kube-system/global-pull-secret-syncer-5pfmn","kube-system/konnectivity-agent-9bl8v","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529","openshift-dns/node-resolver-2zmb2","openshift-image-registry/node-ca-8w9m4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal","openshift-multus/multus-66rhq","openshift-multus/multus-additional-cni-plugins-tq7ss","kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dfn6d"] Sep 16 08:57:24.778397 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.777979 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 16 08:57:24.779186 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.779138 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 08:52:24 +0000 UTC" deadline="2028-03-07 01:07:35.97188715 +0000 UTC" Sep 16 08:57:24.779186 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.779186 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12904h10m11.192704967s" Sep 16 08:57:24.780283 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.780264 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.782520 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.782501 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.783541 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.783520 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-knmhc\"" Sep 16 08:57:24.783541 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.783535 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 16 08:57:24.783656 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.783531 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 16 08:57:24.783703 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.783656 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 16 08:57:24.784731 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.784712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-socket-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.784790 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.784738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-device-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.784790 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.784754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.784896 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.784798 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:24.784896 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.784810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-registration-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.784896 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.784849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.784896 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.784888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-sys-fs\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.785085 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.784911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mfrg\" (UniqueName: \"kubernetes.io/projected/315954c2-e444-46f9-bd36-2ff1648805c8-kube-api-access-6mfrg\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.786521 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.786501 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 16 08:57:24.786613 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.786597 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 16 08:57:24.786660 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.786636 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 16 08:57:24.786765 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.786752 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 16 08:57:24.786950 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.786926 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jsggb\"" Sep 16 08:57:24.787065 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.787052 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 16 08:57:24.787240 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.787226 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 16 08:57:24.787310 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.787278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.787822 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.787800 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 16 08:57:24.787925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.787910 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-28lnk\"" Sep 16 08:57:24.789549 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.789526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:24.789632 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.789603 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:24.791917 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.791902 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:24.792265 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.792241 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 16 08:57:24.792847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.792825 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 16 08:57:24.792847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.792845 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 16 08:57:24.792847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.792855 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 16 08:57:24.793033 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.792825 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-njnzm\"" Sep 16 08:57:24.793033 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.792888 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 16 08:57:24.793033 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.792943 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 16 08:57:24.794191 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.794176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:24.795454 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.795437 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 16 08:57:24.797191 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.797174 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.797279 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.797260 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mdnr5\"" Sep 16 08:57:24.798134 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.798115 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 16 08:57:24.798214 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.798151 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 16 08:57:24.798214 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.798197 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bnkh7\"" Sep 16 08:57:24.798293 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.798271 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 16 08:57:24.798335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.798313 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 16 08:57:24.798468 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.798386 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 16 08:57:24.799662 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.799644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:24.799772 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.799702 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:24.801098 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.801077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tkmqq\"" Sep 16 08:57:24.801191 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.801174 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 16 08:57:24.801260 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.801197 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 16 08:57:24.802187 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.802170 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:24.804697 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.804680 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5524f\"" Sep 16 08:57:24.805560 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.805544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:24.805640 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.805616 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:24.805733 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.805715 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 16 08:57:24.807654 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.807531 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 16 08:57:24.808684 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.808537 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.811683 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.811663 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 16 08:57:24.811826 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.811812 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 16 08:57:24.812347 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.812331 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vgz2r\"" Sep 16 08:57:24.831325 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.831304 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rxdn9" Sep 16 08:57:24.844100 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.844082 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rxdn9" Sep 16 08:57:24.867685 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.867665 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 08:57:24.879755 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.879736 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 16 08:57:24.885280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.885385 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc9rz\" (UniqueName: \"kubernetes.io/projected/883084df-acfa-46a3-8843-f8cd215214e0-kube-api-access-tc9rz\") pod \"node-ca-8w9m4\" (UID: \"883084df-acfa-46a3-8843-f8cd215214e0\") " pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:24.885385 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885302 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-run-netns\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.885385 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-etc-openvswitch\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.885385 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-cnibin\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.885565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/883084df-acfa-46a3-8843-f8cd215214e0-serviceca\") pod \"node-ca-8w9m4\" (UID: \"883084df-acfa-46a3-8843-f8cd215214e0\") " pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:24.885565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/097b0e13-7583-48c7-a62b-0e3babca0d4d-tmp\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.885565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.885565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-cni-bin\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.885768 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-run-multus-certs\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.885768 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885635 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-sysctl-d\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.885768 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-host\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.885768 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-var-lib-openvswitch\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.885768 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.885768 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-multus-socket-dir-parent\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885777 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-var-lib-cni-bin\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6-agent-certs\") pod \"konnectivity-agent-9bl8v\" (UID: \"11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6\") " pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-multus-cni-dir\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-run-k8s-cni-cncf-io\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-systemd\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-sys\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.885967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-sys-fs\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886038 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.886055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886053 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc8d5aba-2ac1-4322-8953-92b305aedbe4-kubelet-config\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886084 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-sys-fs\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-modprobe-d\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-kubelet\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57399f85-9788-4044-8270-57e68e999572-iptables-alerter-script\") pod \"iptables-alerter-tgv55\" (UID: \"57399f85-9788-4044-8270-57e68e999572\") " pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886218 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqrxf\" (UniqueName: \"kubernetes.io/projected/57399f85-9788-4044-8270-57e68e999572-kube-api-access-jqrxf\") pod \"iptables-alerter-tgv55\" (UID: \"57399f85-9788-4044-8270-57e68e999572\") " pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-run-systemd\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-run-openvswitch\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886296 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-hostroot\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-multus-conf-dir\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-lib-modules\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-slash\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-node-log\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.886453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/803c1e19-d9f2-4864-93b1-1e047384c829-hosts-file\") pod \"node-resolver-2zmb2\" (UID: \"803c1e19-d9f2-4864-93b1-1e047384c829\") " pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-system-cni-dir\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107b6f39-e83e-4655-af5c-c277572fa55f-cni-binary-copy\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/107b6f39-e83e-4655-af5c-c277572fa55f-multus-daemon-config\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4k5j\" (UniqueName: \"kubernetes.io/projected/107b6f39-e83e-4655-af5c-c277572fa55f-kube-api-access-s4k5j\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-run-ovn\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76e47c12-fba9-481a-8e21-70292e3fdb0f-ovnkube-script-lib\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn6g4\" (UniqueName: \"kubernetes.io/projected/31a3ae67-af83-4267-bb9d-6d217a293b3a-kube-api-access-cn6g4\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-system-cni-dir\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886634 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-etc-kubernetes\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57399f85-9788-4044-8270-57e68e999572-host-slash\") pod \"iptables-alerter-tgv55\" (UID: \"57399f85-9788-4044-8270-57e68e999572\") " pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-sysconfig\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-kubernetes\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-device-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76e47c12-fba9-481a-8e21-70292e3fdb0f-ovnkube-config\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886771 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-device-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.887055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76e47c12-fba9-481a-8e21-70292e3fdb0f-env-overrides\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnpx8\" (UniqueName: \"kubernetes.io/projected/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-kube-api-access-vnpx8\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-run-netns\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-var-lib-cni-multus\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-tuned\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tvhh\" (UniqueName: \"kubernetes.io/projected/097b0e13-7583-48c7-a62b-0e3babca0d4d-kube-api-access-8tvhh\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mfrg\" (UniqueName: \"kubernetes.io/projected/315954c2-e444-46f9-bd36-2ff1648805c8-kube-api-access-6mfrg\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-systemd-units\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.886981 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-log-socket\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-var-lib-kubelet\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887028 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-sysctl-conf\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-var-lib-kubelet\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-cni-netd\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887124 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.887539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887146 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-cnibin\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-registration-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l4w2\" (UniqueName: \"kubernetes.io/projected/76e47c12-fba9-481a-8e21-70292e3fdb0f-kube-api-access-8l4w2\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc8d5aba-2ac1-4322-8953-92b305aedbe4-dbus\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887284 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-registration-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/883084df-acfa-46a3-8843-f8cd215214e0-host\") pod \"node-ca-8w9m4\" (UID: \"883084df-acfa-46a3-8843-f8cd215214e0\") " pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-socket-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76e47c12-fba9-481a-8e21-70292e3fdb0f-ovn-node-metrics-cert\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/803c1e19-d9f2-4864-93b1-1e047384c829-tmp-dir\") pod \"node-resolver-2zmb2\" (UID: \"803c1e19-d9f2-4864-93b1-1e047384c829\") " pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtctq\" (UniqueName: \"kubernetes.io/projected/803c1e19-d9f2-4864-93b1-1e047384c829-kube-api-access-gtctq\") pod \"node-resolver-2zmb2\" (UID: \"803c1e19-d9f2-4864-93b1-1e047384c829\") " pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887438 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6-konnectivity-ca\") pod \"konnectivity-agent-9bl8v\" (UID: \"11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6\") " pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-run\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.888080 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.887473 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/315954c2-e444-46f9-bd36-2ff1648805c8-socket-dir\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.895095 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.895072 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 16 08:57:24.899289 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.899160 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mfrg\" (UniqueName: \"kubernetes.io/projected/315954c2-e444-46f9-bd36-2ff1648805c8-kube-api-access-6mfrg\") pod \"aws-ebs-csi-driver-node-cv529\" (UID: \"315954c2-e444-46f9-bd36-2ff1648805c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:24.988381 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc8d5aba-2ac1-4322-8953-92b305aedbe4-kubelet-config\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:24.988381 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-modprobe-d\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-kubelet\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57399f85-9788-4044-8270-57e68e999572-iptables-alerter-script\") pod \"iptables-alerter-tgv55\" (UID: \"57399f85-9788-4044-8270-57e68e999572\") " pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988474 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc8d5aba-2ac1-4322-8953-92b305aedbe4-kubelet-config\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988489 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-kubelet\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-modprobe-d\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqrxf\" (UniqueName: \"kubernetes.io/projected/57399f85-9788-4044-8270-57e68e999572-kube-api-access-jqrxf\") pod \"iptables-alerter-tgv55\" (UID: \"57399f85-9788-4044-8270-57e68e999572\") " pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-run-systemd\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-run-openvswitch\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.988587 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.988575 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988613 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-run-openvswitch\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988612 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-run-systemd\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988647 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-hostroot\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.988667 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs podName:31a3ae67-af83-4267-bb9d-6d217a293b3a nodeName:}" failed. No retries permitted until 2026-09-16 08:57:25.488642183 +0000 UTC m=+2.076403782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs") pod "network-metrics-daemon-t4hbk" (UID: "31a3ae67-af83-4267-bb9d-6d217a293b3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988682 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-hostroot\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-multus-conf-dir\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-lib-modules\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-multus-conf-dir\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-slash\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-node-log\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988840 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-slash\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988849 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-lib-modules\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/803c1e19-d9f2-4864-93b1-1e047384c829-hosts-file\") pod \"node-resolver-2zmb2\" (UID: \"803c1e19-d9f2-4864-93b1-1e047384c829\") " pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-system-cni-dir\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988888 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-node-log\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989045 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988925 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/803c1e19-d9f2-4864-93b1-1e047384c829-hosts-file\") pod \"node-resolver-2zmb2\" (UID: \"803c1e19-d9f2-4864-93b1-1e047384c829\") " pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988947 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988935 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-system-cni-dir\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107b6f39-e83e-4655-af5c-c277572fa55f-cni-binary-copy\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989018 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/107b6f39-e83e-4655-af5c-c277572fa55f-multus-daemon-config\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.988999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57399f85-9788-4044-8270-57e68e999572-iptables-alerter-script\") pod \"iptables-alerter-tgv55\" (UID: \"57399f85-9788-4044-8270-57e68e999572\") " pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4k5j\" (UniqueName: \"kubernetes.io/projected/107b6f39-e83e-4655-af5c-c277572fa55f-kube-api-access-s4k5j\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-run-ovn\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76e47c12-fba9-481a-8e21-70292e3fdb0f-ovnkube-script-lib\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn6g4\" (UniqueName: \"kubernetes.io/projected/31a3ae67-af83-4267-bb9d-6d217a293b3a-kube-api-access-cn6g4\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-system-cni-dir\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989169 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-run-ovn\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-etc-kubernetes\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57399f85-9788-4044-8270-57e68e999572-host-slash\") pod \"iptables-alerter-tgv55\" (UID: \"57399f85-9788-4044-8270-57e68e999572\") " pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-sysconfig\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-kubernetes\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989338 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-etc-kubernetes\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.989934 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989393 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57399f85-9788-4044-8270-57e68e999572-host-slash\") pod \"iptables-alerter-tgv55\" (UID: \"57399f85-9788-4044-8270-57e68e999572\") " pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989406 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-sysconfig\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76e47c12-fba9-481a-8e21-70292e3fdb0f-ovnkube-config\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76e47c12-fba9-481a-8e21-70292e3fdb0f-env-overrides\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989492 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-system-cni-dir\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpx8\" (UniqueName: \"kubernetes.io/projected/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-kube-api-access-vnpx8\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-run-netns\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989536 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-kubernetes\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/107b6f39-e83e-4655-af5c-c277572fa55f-multus-daemon-config\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989596 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-run-netns\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989615 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/107b6f39-e83e-4655-af5c-c277572fa55f-cni-binary-copy\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-var-lib-cni-multus\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989690 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-var-lib-cni-multus\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-tuned\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tvhh\" (UniqueName: \"kubernetes.io/projected/097b0e13-7583-48c7-a62b-0e3babca0d4d-kube-api-access-8tvhh\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-systemd-units\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-log-socket\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989801 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76e47c12-fba9-481a-8e21-70292e3fdb0f-ovnkube-script-lib\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.990925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989823 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-systemd-units\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-var-lib-kubelet\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989882 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-log-socket\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989898 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-var-lib-kubelet\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-sysctl-conf\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-var-lib-kubelet\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989956 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76e47c12-fba9-481a-8e21-70292e3fdb0f-env-overrides\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-cni-netd\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.989994 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-cni-netd\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.989983 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990018 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-var-lib-kubelet\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990031 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76e47c12-fba9-481a-8e21-70292e3fdb0f-ovnkube-config\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990049 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-sysctl-conf\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:24.990068 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret podName:cc8d5aba-2ac1-4322-8953-92b305aedbe4 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:25.490050344 +0000 UTC m=+2.077811921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret") pod "global-pull-secret-syncer-5pfmn" (UID: "cc8d5aba-2ac1-4322-8953-92b305aedbe4") : object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.991661 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-cnibin\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l4w2\" (UniqueName: \"kubernetes.io/projected/76e47c12-fba9-481a-8e21-70292e3fdb0f-kube-api-access-8l4w2\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990168 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-cnibin\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc8d5aba-2ac1-4322-8953-92b305aedbe4-dbus\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/883084df-acfa-46a3-8843-f8cd215214e0-host\") pod \"node-ca-8w9m4\" (UID: \"883084df-acfa-46a3-8843-f8cd215214e0\") " pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76e47c12-fba9-481a-8e21-70292e3fdb0f-ovn-node-metrics-cert\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990297 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990310 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/883084df-acfa-46a3-8843-f8cd215214e0-host\") pod \"node-ca-8w9m4\" (UID: \"883084df-acfa-46a3-8843-f8cd215214e0\") " pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/803c1e19-d9f2-4864-93b1-1e047384c829-tmp-dir\") pod \"node-resolver-2zmb2\" (UID: \"803c1e19-d9f2-4864-93b1-1e047384c829\") " pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtctq\" (UniqueName: \"kubernetes.io/projected/803c1e19-d9f2-4864-93b1-1e047384c829-kube-api-access-gtctq\") pod \"node-resolver-2zmb2\" (UID: \"803c1e19-d9f2-4864-93b1-1e047384c829\") " pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6-konnectivity-ca\") pod \"konnectivity-agent-9bl8v\" (UID: \"11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6\") " pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990410 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-run\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990439 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc8d5aba-2ac1-4322-8953-92b305aedbe4-dbus\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc9rz\" (UniqueName: \"kubernetes.io/projected/883084df-acfa-46a3-8843-f8cd215214e0-kube-api-access-tc9rz\") pod \"node-ca-8w9m4\" (UID: \"883084df-acfa-46a3-8843-f8cd215214e0\") " pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-run-netns\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990529 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-cni-binary-copy\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-etc-openvswitch\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-cnibin\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990576 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-etc-openvswitch\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990594 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/803c1e19-d9f2-4864-93b1-1e047384c829-tmp-dir\") pod \"node-resolver-2zmb2\" (UID: \"803c1e19-d9f2-4864-93b1-1e047384c829\") " pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/883084df-acfa-46a3-8843-f8cd215214e0-serviceca\") pod \"node-ca-8w9m4\" (UID: \"883084df-acfa-46a3-8843-f8cd215214e0\") " pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-run-netns\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/097b0e13-7583-48c7-a62b-0e3babca0d4d-tmp\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990678 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-cnibin\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-cni-bin\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-run-multus-certs\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-run\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-sysctl-d\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-host\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990782 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-var-lib-openvswitch\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.992830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-multus-socket-dir-parent\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-var-lib-cni-bin\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6-agent-certs\") pod \"konnectivity-agent-9bl8v\" (UID: \"11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6\") " pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990984 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991038 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-run-multus-certs\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-host-cni-bin\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.990986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-multus-cni-dir\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-run-k8s-cni-cncf-io\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991112 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-multus-cni-dir\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991153 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-sysctl-d\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991156 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-run-k8s-cni-cncf-io\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991173 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-host\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-systemd\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-sys\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991221 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-host-var-lib-cni-bin\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991223 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-systemd\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991234 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6-konnectivity-ca\") pod \"konnectivity-agent-9bl8v\" (UID: \"11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6\") " pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:24.993442 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/107b6f39-e83e-4655-af5c-c277572fa55f-multus-socket-dir-parent\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:24.994028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991247 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/883084df-acfa-46a3-8843-f8cd215214e0-serviceca\") pod \"node-ca-8w9m4\" (UID: \"883084df-acfa-46a3-8843-f8cd215214e0\") " pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:24.994028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/097b0e13-7583-48c7-a62b-0e3babca0d4d-sys\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.994028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991304 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76e47c12-fba9-481a-8e21-70292e3fdb0f-var-lib-openvswitch\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.994028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.991563 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:24.994028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.992995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/097b0e13-7583-48c7-a62b-0e3babca0d4d-etc-tuned\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.994028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.993210 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76e47c12-fba9-481a-8e21-70292e3fdb0f-ovn-node-metrics-cert\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:24.994028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.993445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/097b0e13-7583-48c7-a62b-0e3babca0d4d-tmp\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:24.994028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:24.993599 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6-agent-certs\") pod \"konnectivity-agent-9bl8v\" (UID: \"11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6\") " pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:25.001923 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.001900 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4k5j\" (UniqueName: \"kubernetes.io/projected/107b6f39-e83e-4655-af5c-c277572fa55f-kube-api-access-s4k5j\") pod \"multus-66rhq\" (UID: \"107b6f39-e83e-4655-af5c-c277572fa55f\") " pod="openshift-multus/multus-66rhq" Sep 16 08:57:25.003312 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.003287 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 08:57:25.003312 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.003309 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 08:57:25.003473 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.003313 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqrxf\" (UniqueName: \"kubernetes.io/projected/57399f85-9788-4044-8270-57e68e999572-kube-api-access-jqrxf\") pod \"iptables-alerter-tgv55\" (UID: \"57399f85-9788-4044-8270-57e68e999572\") " pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:25.003473 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.003324 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xstfp for pod openshift-network-diagnostics/network-check-target-j6g7d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:25.003473 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.003400 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp podName:eb92dc39-94de-4878-8934-3ba5387f3c55 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:25.503382098 +0000 UTC m=+2.091143674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xstfp" (UniqueName: "kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp") pod "network-check-target-j6g7d" (UID: "eb92dc39-94de-4878-8934-3ba5387f3c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:25.004569 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.004547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tvhh\" (UniqueName: \"kubernetes.io/projected/097b0e13-7583-48c7-a62b-0e3babca0d4d-kube-api-access-8tvhh\") pod \"tuned-dfn6d\" (UID: \"097b0e13-7583-48c7-a62b-0e3babca0d4d\") " pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:25.005753 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.005726 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc9rz\" (UniqueName: \"kubernetes.io/projected/883084df-acfa-46a3-8843-f8cd215214e0-kube-api-access-tc9rz\") pod \"node-ca-8w9m4\" (UID: \"883084df-acfa-46a3-8843-f8cd215214e0\") " pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:25.005979 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.005960 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtctq\" (UniqueName: \"kubernetes.io/projected/803c1e19-d9f2-4864-93b1-1e047384c829-kube-api-access-gtctq\") pod \"node-resolver-2zmb2\" (UID: \"803c1e19-d9f2-4864-93b1-1e047384c829\") " pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:25.006958 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.006907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn6g4\" (UniqueName: \"kubernetes.io/projected/31a3ae67-af83-4267-bb9d-6d217a293b3a-kube-api-access-cn6g4\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:25.007438 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.007412 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l4w2\" (UniqueName: \"kubernetes.io/projected/76e47c12-fba9-481a-8e21-70292e3fdb0f-kube-api-access-8l4w2\") pod \"ovnkube-node-vtwpg\" (UID: \"76e47c12-fba9-481a-8e21-70292e3fdb0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:25.008979 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.008961 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnpx8\" (UniqueName: \"kubernetes.io/projected/f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55-kube-api-access-vnpx8\") pod \"multus-additional-cni-plugins-tq7ss\" (UID: \"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55\") " pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:25.033435 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.033402 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22de053db9641afe6104c22d09ccaea9.slice/crio-608b050162d59a16e0a7ee0466c91b9019f24a2d50875ad2ce0203cdff382f6a WatchSource:0}: Error finding container 608b050162d59a16e0a7ee0466c91b9019f24a2d50875ad2ce0203cdff382f6a: Status 404 returned error can't find the container with id 608b050162d59a16e0a7ee0466c91b9019f24a2d50875ad2ce0203cdff382f6a Sep 16 08:57:25.037756 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.037739 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 08:57:25.111862 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.111771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" Sep 16 08:57:25.122807 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.122773 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315954c2_e444_46f9_bd36_2ff1648805c8.slice/crio-71a3e89394b77713bb96960f6f5164532a71d240df42b8ae83ddb94f56ee3b1b WatchSource:0}: Error finding container 71a3e89394b77713bb96960f6f5164532a71d240df42b8ae83ddb94f56ee3b1b: Status 404 returned error can't find the container with id 71a3e89394b77713bb96960f6f5164532a71d240df42b8ae83ddb94f56ee3b1b Sep 16 08:57:25.131325 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.131303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-66rhq" Sep 16 08:57:25.141074 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.141051 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107b6f39_e83e_4655_af5c_c277572fa55f.slice/crio-54a91f20ceea52b0f04c358dcaf43390bd4122ca060f3d044e788dba765da632 WatchSource:0}: Error finding container 54a91f20ceea52b0f04c358dcaf43390bd4122ca060f3d044e788dba765da632: Status 404 returned error can't find the container with id 54a91f20ceea52b0f04c358dcaf43390bd4122ca060f3d044e788dba765da632 Sep 16 08:57:25.161983 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.161956 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tgv55" Sep 16 08:57:25.170282 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.170258 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57399f85_9788_4044_8270_57e68e999572.slice/crio-d8a47c47071461bc3498be4cd37b25be6c1d2856cd75c74e3764bfdee9f7592e WatchSource:0}: Error finding container d8a47c47071461bc3498be4cd37b25be6c1d2856cd75c74e3764bfdee9f7592e: Status 404 returned error can't find the container with id d8a47c47071461bc3498be4cd37b25be6c1d2856cd75c74e3764bfdee9f7592e Sep 16 08:57:25.174633 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.174614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:25.181774 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.181751 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:25.183680 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.183649 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e47c12_fba9_481a_8e21_70292e3fdb0f.slice/crio-e9ed644fe5dc68e66a41b92c027c4ecee07e2fc19a498ceca87bdbcacd112c77 WatchSource:0}: Error finding container e9ed644fe5dc68e66a41b92c027c4ecee07e2fc19a498ceca87bdbcacd112c77: Status 404 returned error can't find the container with id e9ed644fe5dc68e66a41b92c027c4ecee07e2fc19a498ceca87bdbcacd112c77 Sep 16 08:57:25.193076 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.193054 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c8e918_ff0a_4fe2_9446_6dd3fd3a6af6.slice/crio-886a883ec4e90a4f0976e9bab6080f403f770305e7c315fb926706ef4b7c41b8 WatchSource:0}: Error finding container 886a883ec4e90a4f0976e9bab6080f403f770305e7c315fb926706ef4b7c41b8: Status 404 returned error can't find the container with id 886a883ec4e90a4f0976e9bab6080f403f770305e7c315fb926706ef4b7c41b8 Sep 16 08:57:25.199088 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.199063 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8w9m4" Sep 16 08:57:25.207577 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.207552 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883084df_acfa_46a3_8843_f8cd215214e0.slice/crio-51715522774dc157c898f1ed341fd756908f0f24e655294565fcadb02c7a35bc WatchSource:0}: Error finding container 51715522774dc157c898f1ed341fd756908f0f24e655294565fcadb02c7a35bc: Status 404 returned error can't find the container with id 51715522774dc157c898f1ed341fd756908f0f24e655294565fcadb02c7a35bc Sep 16 08:57:25.216055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.216035 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" Sep 16 08:57:25.224293 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.224272 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097b0e13_7583_48c7_a62b_0e3babca0d4d.slice/crio-4b8872a16d51755cd96b24f0efcc4454e847299e3d3dd48a64d57bb4faf5a385 WatchSource:0}: Error finding container 4b8872a16d51755cd96b24f0efcc4454e847299e3d3dd48a64d57bb4faf5a385: Status 404 returned error can't find the container with id 4b8872a16d51755cd96b24f0efcc4454e847299e3d3dd48a64d57bb4faf5a385 Sep 16 08:57:25.227815 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.227797 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2zmb2" Sep 16 08:57:25.231874 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.231858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" Sep 16 08:57:25.236639 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.236617 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803c1e19_d9f2_4864_93b1_1e047384c829.slice/crio-3b77ad2c82ddf1094d1cb84c563297555da504c3a7d754275789b9624c909b3a WatchSource:0}: Error finding container 3b77ad2c82ddf1094d1cb84c563297555da504c3a7d754275789b9624c909b3a: Status 404 returned error can't find the container with id 3b77ad2c82ddf1094d1cb84c563297555da504c3a7d754275789b9624c909b3a Sep 16 08:57:25.240381 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:25.240361 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f04cb6_30b3_4bcf_a6c9_13a95ad2bb55.slice/crio-fa673dfea693bf0e5d5a477fbee95c9f0586e6fbcdc1a06b1ee07565170fc2f0 WatchSource:0}: Error finding container fa673dfea693bf0e5d5a477fbee95c9f0586e6fbcdc1a06b1ee07565170fc2f0: Status 404 returned error can't find the container with id fa673dfea693bf0e5d5a477fbee95c9f0586e6fbcdc1a06b1ee07565170fc2f0 Sep 16 08:57:25.494718 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.494632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:25.494718 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.494692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:25.494921 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.494786 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:25.494921 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.494849 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret podName:cc8d5aba-2ac1-4322-8953-92b305aedbe4 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:26.494831024 +0000 UTC m=+3.082592597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret") pod "global-pull-secret-syncer-5pfmn" (UID: "cc8d5aba-2ac1-4322-8953-92b305aedbe4") : object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:25.494921 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.494786 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:25.495050 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.494931 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs podName:31a3ae67-af83-4267-bb9d-6d217a293b3a nodeName:}" failed. No retries permitted until 2026-09-16 08:57:26.494918583 +0000 UTC m=+3.082680156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs") pod "network-metrics-daemon-t4hbk" (UID: "31a3ae67-af83-4267-bb9d-6d217a293b3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:25.595766 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.595733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:25.595971 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.595921 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 08:57:25.595971 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.595943 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 08:57:25.595971 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.595957 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xstfp for pod openshift-network-diagnostics/network-check-target-j6g7d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:25.596151 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.596021 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp podName:eb92dc39-94de-4878-8934-3ba5387f3c55 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:26.596000803 +0000 UTC m=+3.183762397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xstfp" (UniqueName: "kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp") pod "network-check-target-j6g7d" (UID: "eb92dc39-94de-4878-8934-3ba5387f3c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:25.633958 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.633929 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 08:57:25.848100 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.847984 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 08:52:25 +0000 UTC" deadline="2028-05-20 20:33:45.922993855 +0000 UTC" Sep 16 08:57:25.848100 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.848049 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14699h36m20.074949917s" Sep 16 08:57:25.910993 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.910952 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:25.911182 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:25.911096 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:25.928836 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.928717 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2zmb2" event={"ID":"803c1e19-d9f2-4864-93b1-1e047384c829","Type":"ContainerStarted","Data":"3b77ad2c82ddf1094d1cb84c563297555da504c3a7d754275789b9624c909b3a"} Sep 16 08:57:25.938805 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.938710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8w9m4" event={"ID":"883084df-acfa-46a3-8843-f8cd215214e0","Type":"ContainerStarted","Data":"51715522774dc157c898f1ed341fd756908f0f24e655294565fcadb02c7a35bc"} Sep 16 08:57:25.950588 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.950510 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9bl8v" event={"ID":"11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6","Type":"ContainerStarted","Data":"886a883ec4e90a4f0976e9bab6080f403f770305e7c315fb926706ef4b7c41b8"} Sep 16 08:57:25.954617 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.954493 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" event={"ID":"76e47c12-fba9-481a-8e21-70292e3fdb0f","Type":"ContainerStarted","Data":"e9ed644fe5dc68e66a41b92c027c4ecee07e2fc19a498ceca87bdbcacd112c77"} Sep 16 08:57:25.958749 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.958667 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-66rhq" event={"ID":"107b6f39-e83e-4655-af5c-c277572fa55f","Type":"ContainerStarted","Data":"54a91f20ceea52b0f04c358dcaf43390bd4122ca060f3d044e788dba765da632"} Sep 16 08:57:25.963232 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.963108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" event={"ID":"315954c2-e444-46f9-bd36-2ff1648805c8","Type":"ContainerStarted","Data":"71a3e89394b77713bb96960f6f5164532a71d240df42b8ae83ddb94f56ee3b1b"} Sep 16 08:57:25.967773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.967751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" event={"ID":"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55","Type":"ContainerStarted","Data":"fa673dfea693bf0e5d5a477fbee95c9f0586e6fbcdc1a06b1ee07565170fc2f0"} Sep 16 08:57:25.973313 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.973270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" event={"ID":"097b0e13-7583-48c7-a62b-0e3babca0d4d","Type":"ContainerStarted","Data":"4b8872a16d51755cd96b24f0efcc4454e847299e3d3dd48a64d57bb4faf5a385"} Sep 16 08:57:25.975724 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.975637 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tgv55" event={"ID":"57399f85-9788-4044-8270-57e68e999572","Type":"ContainerStarted","Data":"d8a47c47071461bc3498be4cd37b25be6c1d2856cd75c74e3764bfdee9f7592e"} Sep 16 08:57:25.980114 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:25.980067 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"22de053db9641afe6104c22d09ccaea9","Type":"ContainerStarted","Data":"608b050162d59a16e0a7ee0466c91b9019f24a2d50875ad2ce0203cdff382f6a"} Sep 16 08:57:26.266295 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:26.266212 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 08:57:26.335414 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:57:26.335378 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode504b6ddcb0faa30a582965ff580b686.slice/crio-9563f9f4e3b2a7b2eb841861e696ae5529f0748dc7ce340ad257bf84a8689c4f WatchSource:0}: Error finding container 9563f9f4e3b2a7b2eb841861e696ae5529f0748dc7ce340ad257bf84a8689c4f: Status 404 returned error can't find the container with id 9563f9f4e3b2a7b2eb841861e696ae5529f0748dc7ce340ad257bf84a8689c4f Sep 16 08:57:26.505729 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:26.505684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:26.505932 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:26.505796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:26.506038 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.506012 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:26.506097 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.506083 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs podName:31a3ae67-af83-4267-bb9d-6d217a293b3a nodeName:}" failed. No retries permitted until 2026-09-16 08:57:28.506063636 +0000 UTC m=+5.093825215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs") pod "network-metrics-daemon-t4hbk" (UID: "31a3ae67-af83-4267-bb9d-6d217a293b3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:26.506455 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.506434 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:26.506561 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.506505 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret podName:cc8d5aba-2ac1-4322-8953-92b305aedbe4 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:28.50648049 +0000 UTC m=+5.094242070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret") pod "global-pull-secret-syncer-5pfmn" (UID: "cc8d5aba-2ac1-4322-8953-92b305aedbe4") : object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:26.607855 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:26.607148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:26.607855 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.607355 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 08:57:26.607855 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.607376 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 08:57:26.607855 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.607392 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xstfp for pod openshift-network-diagnostics/network-check-target-j6g7d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:26.607855 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.607453 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp podName:eb92dc39-94de-4878-8934-3ba5387f3c55 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:28.607434099 +0000 UTC m=+5.195195692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xstfp" (UniqueName: "kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp") pod "network-check-target-j6g7d" (UID: "eb92dc39-94de-4878-8934-3ba5387f3c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:26.724660 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:26.724398 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 16 08:57:26.848263 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:26.848214 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 08:52:25 +0000 UTC" deadline="2028-06-05 17:11:52.963627708 +0000 UTC" Sep 16 08:57:26.848263 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:26.848259 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15080h14m26.115372921s" Sep 16 08:57:26.912096 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:26.910994 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:26.912096 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.911154 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:26.912096 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:26.911860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:26.912096 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:26.911984 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:27.024516 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:27.024429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" event={"ID":"e504b6ddcb0faa30a582965ff580b686","Type":"ContainerStarted","Data":"9563f9f4e3b2a7b2eb841861e696ae5529f0748dc7ce340ad257bf84a8689c4f"} Sep 16 08:57:27.925786 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:27.925219 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:27.925786 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:27.925352 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:28.525344 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:28.524524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:28.525344 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:28.524594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:28.525344 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.524715 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:28.525344 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.524779 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret podName:cc8d5aba-2ac1-4322-8953-92b305aedbe4 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:32.524759655 +0000 UTC m=+9.112521233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret") pod "global-pull-secret-syncer-5pfmn" (UID: "cc8d5aba-2ac1-4322-8953-92b305aedbe4") : object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:28.525344 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.524848 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:28.525344 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.524884 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs podName:31a3ae67-af83-4267-bb9d-6d217a293b3a nodeName:}" failed. No retries permitted until 2026-09-16 08:57:32.524869944 +0000 UTC m=+9.112631528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs") pod "network-metrics-daemon-t4hbk" (UID: "31a3ae67-af83-4267-bb9d-6d217a293b3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:28.626218 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:28.625533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:28.626218 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.625749 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 08:57:28.626218 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.625774 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 08:57:28.626218 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.625787 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xstfp for pod openshift-network-diagnostics/network-check-target-j6g7d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:28.626218 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.625845 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp podName:eb92dc39-94de-4878-8934-3ba5387f3c55 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:32.625825505 +0000 UTC m=+9.213587086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xstfp" (UniqueName: "kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp") pod "network-check-target-j6g7d" (UID: "eb92dc39-94de-4878-8934-3ba5387f3c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:28.912248 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:28.911441 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:28.912248 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.911613 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:28.912248 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:28.912044 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:28.912248 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:28.912148 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:29.911696 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:29.911439 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:29.911696 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:29.911574 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:30.910853 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:30.910811 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:30.911060 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:30.910965 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:30.911124 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:30.911096 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:30.911258 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:30.911228 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:31.914609 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:31.914578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:31.915116 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:31.914719 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:32.562341 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:32.562305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:32.562524 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:32.562391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:32.562524 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.562486 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:32.562524 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.562502 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:32.562698 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.562568 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs podName:31a3ae67-af83-4267-bb9d-6d217a293b3a nodeName:}" failed. No retries permitted until 2026-09-16 08:57:40.562548665 +0000 UTC m=+17.150310238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs") pod "network-metrics-daemon-t4hbk" (UID: "31a3ae67-af83-4267-bb9d-6d217a293b3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:32.562698 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.562587 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret podName:cc8d5aba-2ac1-4322-8953-92b305aedbe4 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:40.562578958 +0000 UTC m=+17.150340535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret") pod "global-pull-secret-syncer-5pfmn" (UID: "cc8d5aba-2ac1-4322-8953-92b305aedbe4") : object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:32.663549 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:32.662920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:32.663549 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.663105 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 08:57:32.663549 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.663129 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 08:57:32.663549 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.663143 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xstfp for pod openshift-network-diagnostics/network-check-target-j6g7d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:32.663549 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.663206 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp podName:eb92dc39-94de-4878-8934-3ba5387f3c55 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:40.66318717 +0000 UTC m=+17.250948745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xstfp" (UniqueName: "kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp") pod "network-check-target-j6g7d" (UID: "eb92dc39-94de-4878-8934-3ba5387f3c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:32.911776 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:32.911048 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:32.911776 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.911184 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:32.911776 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:32.911559 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:32.911776 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:32.911660 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:33.912802 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:33.912306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:33.912802 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:33.912427 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:34.911597 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:34.911560 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:34.911774 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:34.911692 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:34.911774 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:34.911723 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:34.911903 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:34.911785 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:35.911621 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:35.911584 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:35.912037 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:35.911700 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:36.911642 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:36.911592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:36.912121 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:36.911592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:36.912121 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:36.911728 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:36.912121 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:36.911790 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:37.911086 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:37.911054 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:37.911243 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:37.911178 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:38.911453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:38.911411 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:38.911972 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:38.911412 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:38.911972 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:38.911556 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:38.911972 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:38.911675 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:39.911354 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:39.911306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:39.911547 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:39.911453 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:40.624669 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:40.624630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:40.624901 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:40.624690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:40.624901 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.624790 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:40.624901 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.624805 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:40.624901 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.624877 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs podName:31a3ae67-af83-4267-bb9d-6d217a293b3a nodeName:}" failed. No retries permitted until 2026-09-16 08:57:56.624840109 +0000 UTC m=+33.212601680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs") pod "network-metrics-daemon-t4hbk" (UID: "31a3ae67-af83-4267-bb9d-6d217a293b3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:40.624901 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.624893 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret podName:cc8d5aba-2ac1-4322-8953-92b305aedbe4 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:56.624886039 +0000 UTC m=+33.212647610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret") pod "global-pull-secret-syncer-5pfmn" (UID: "cc8d5aba-2ac1-4322-8953-92b305aedbe4") : object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:40.725233 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:40.725192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:40.725418 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.725360 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 08:57:40.725418 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.725383 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 08:57:40.725418 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.725397 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xstfp for pod openshift-network-diagnostics/network-check-target-j6g7d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:40.725598 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.725466 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp podName:eb92dc39-94de-4878-8934-3ba5387f3c55 nodeName:}" failed. No retries permitted until 2026-09-16 08:57:56.725448039 +0000 UTC m=+33.313209614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xstfp" (UniqueName: "kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp") pod "network-check-target-j6g7d" (UID: "eb92dc39-94de-4878-8934-3ba5387f3c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:40.911180 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:40.911090 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:40.911180 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:40.911130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:40.911481 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.911223 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:40.911481 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:40.911346 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:41.910856 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:41.910819 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:41.911334 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:41.910985 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:42.911257 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:42.911221 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:42.911705 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:42.911332 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:42.911705 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:42.911394 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:42.911705 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:42.911538 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:43.912016 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:43.911985 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:43.912561 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:43.912108 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:44.911692 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:44.910940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:44.911692 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:44.911045 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:44.911692 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:44.911117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:44.911692 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:44.911197 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:45.097459 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:45.097087 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" event={"ID":"76e47c12-fba9-481a-8e21-70292e3fdb0f","Type":"ContainerStarted","Data":"8bf3c576281e1a35cebe362df8e1e8d96a180aabc7e1808efbd9f6a76e011f31"} Sep 16 08:57:45.122612 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:45.122567 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" event={"ID":"e504b6ddcb0faa30a582965ff580b686","Type":"ContainerStarted","Data":"a73c5581b0bf6dcf5ff4dbd69725f8df9da20f6bfaadea59a7d605060b5f2bcf"} Sep 16 08:57:45.129937 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:45.129901 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" event={"ID":"097b0e13-7583-48c7-a62b-0e3babca0d4d","Type":"ContainerStarted","Data":"d0775c277c6b0d34e82bd6acf057a1805e37c5837049fdab9110f417d1ffefb8"} Sep 16 08:57:45.137439 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:45.137381 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-124.ec2.internal" podStartSLOduration=20.137362104 podStartE2EDuration="20.137362104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:45.137120051 +0000 UTC m=+21.724881646" watchObservedRunningTime="2026-09-16 08:57:45.137362104 +0000 UTC m=+21.725123700" Sep 16 08:57:45.157177 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:45.156797 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dfn6d" podStartSLOduration=1.452318492 podStartE2EDuration="21.156774829s" totalImagesPullingTime="19.704456337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:45.156362441 +0000 UTC m=+21.744124061" watchObservedRunningTime="2026-09-16 08:57:45.156774829 +0000 UTC m=+21.744536424" Sep 16 08:57:45.911446 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:45.911370 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:45.911852 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:45.911484 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:46.133903 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.133842 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55" containerID="dc3df4de6656323f5228bc7157f74141f7722b7fc1515f9f01dbb6ddd1d8e110" exitCode=0 Sep 16 08:57:46.134569 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.133942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" event={"ID":"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55","Type":"ContainerDied","Data":"dc3df4de6656323f5228bc7157f74141f7722b7fc1515f9f01dbb6ddd1d8e110"} Sep 16 08:57:46.136215 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.136153 2564 generic.go:356] "Generic (PLEG): container finished" podID="22de053db9641afe6104c22d09ccaea9" containerID="d17a739dd3b839c014f4a83392d9c809463f56b36081abed3c258b6c6b476c76" exitCode=0 Sep 16 08:57:46.136305 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.136282 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"22de053db9641afe6104c22d09ccaea9","Type":"ContainerDied","Data":"d17a739dd3b839c014f4a83392d9c809463f56b36081abed3c258b6c6b476c76"} Sep 16 08:57:46.138401 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.138368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2zmb2" event={"ID":"803c1e19-d9f2-4864-93b1-1e047384c829","Type":"ContainerStarted","Data":"e3cc1dbb3add51b84b49404a5b137f084de1bc83074862f72608dd684efe9d2e"} Sep 16 08:57:46.140971 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.140928 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8w9m4" event={"ID":"883084df-acfa-46a3-8843-f8cd215214e0","Type":"ContainerStarted","Data":"bce1985e557788f16bfd699198aac62bccab5e7dfbbbd3547551be2de30fba63"} Sep 16 08:57:46.142754 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.142716 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9bl8v" event={"ID":"11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6","Type":"ContainerStarted","Data":"fcf250b3ba4d781fd4c34061f1735fde4410a752a112fa8e0c79b59130f87804"} Sep 16 08:57:46.146453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.146423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" event={"ID":"76e47c12-fba9-481a-8e21-70292e3fdb0f","Type":"ContainerStarted","Data":"844206dd0d617d01cfa7ee630d1adcbdcb4e2ab137fb787549a7416a21e593ed"} Sep 16 08:57:46.146569 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.146505 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" event={"ID":"76e47c12-fba9-481a-8e21-70292e3fdb0f","Type":"ContainerStarted","Data":"8980004d6ae6f45d9c48205f9c7851176b81f690dc17e797672973f028085405"} Sep 16 08:57:46.146569 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.146556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" event={"ID":"76e47c12-fba9-481a-8e21-70292e3fdb0f","Type":"ContainerStarted","Data":"3a773b1f52845e3b01e9a4b26e86d7ad36284a7d90d6c439bb9e4a2aa2d46cfa"} Sep 16 08:57:46.146679 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.146604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" event={"ID":"76e47c12-fba9-481a-8e21-70292e3fdb0f","Type":"ContainerStarted","Data":"72e7084b8eb5aee51cfcee24c8489ce965ac6e2adaf7d34fb5ef091470b96f9c"} Sep 16 08:57:46.146679 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.146651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" event={"ID":"76e47c12-fba9-481a-8e21-70292e3fdb0f","Type":"ContainerStarted","Data":"fea915c13671949859f478175452b9eac8ad923041fd71936998e99cebc7999d"} Sep 16 08:57:46.148254 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.148150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-66rhq" event={"ID":"107b6f39-e83e-4655-af5c-c277572fa55f","Type":"ContainerStarted","Data":"191ebaf4a37af6e14fb9c90deac80d8f64076339eb6a7f97e34583db516647a0"} Sep 16 08:57:46.149754 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.149728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" event={"ID":"315954c2-e444-46f9-bd36-2ff1648805c8","Type":"ContainerStarted","Data":"96944a2d25e81d120bda3ab2deabdd4a58e2a0b76abcb5a2e810d623b7c7d2d8"} Sep 16 08:57:46.176044 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.175985 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8w9m4" podStartSLOduration=2.485066529 podStartE2EDuration="22.175963305s" totalImagesPullingTime="19.690896776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:46.17513102 +0000 UTC m=+22.762892615" watchObservedRunningTime="2026-09-16 08:57:46.175963305 +0000 UTC m=+22.763724900" Sep 16 08:57:46.211922 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.211847 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-66rhq" podStartSLOduration=2.392091766 podStartE2EDuration="22.211824888s" totalImagesPullingTime="19.819733122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:46.211376802 +0000 UTC m=+22.799138397" watchObservedRunningTime="2026-09-16 08:57:46.211824888 +0000 UTC m=+22.799586483" Sep 16 08:57:46.227413 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.227364 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9bl8v" podStartSLOduration=6.193762624 podStartE2EDuration="22.227343533s" totalImagesPullingTime="16.033580909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:46.226709571 +0000 UTC m=+22.814471168" watchObservedRunningTime="2026-09-16 08:57:46.227343533 +0000 UTC m=+22.815105128" Sep 16 08:57:46.245450 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.245392 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2zmb2" podStartSLOduration=2.585150698 podStartE2EDuration="22.24537465s" totalImagesPullingTime="19.660223952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:46.245211261 +0000 UTC m=+22.832972856" watchObservedRunningTime="2026-09-16 08:57:46.24537465 +0000 UTC m=+22.833136244" Sep 16 08:57:46.877258 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.877092 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 16 08:57:46.911200 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.911165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:46.911385 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:46.911307 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:46.911385 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:46.911332 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:46.911509 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:46.911485 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:47.156163 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:47.156043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tgv55" event={"ID":"57399f85-9788-4044-8270-57e68e999572","Type":"ContainerStarted","Data":"44ba31fcd27bb38e2e2a50a99be8babcefdf487cbd5b9bb79155c0d4b03da2e6"} Sep 16 08:57:47.157858 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:47.157835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" event={"ID":"22de053db9641afe6104c22d09ccaea9","Type":"ContainerStarted","Data":"6053ffaeee8f020bd67dfacce349d9aeebf44c942ca590293dfbb8e77e9570f7"} Sep 16 08:57:47.159725 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:47.159702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" event={"ID":"315954c2-e444-46f9-bd36-2ff1648805c8","Type":"ContainerStarted","Data":"a5e8e24110777a9f6126468d955d26c359a68d0c261392383e78fe6962bb7e8b"} Sep 16 08:57:47.172267 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:47.172216 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tgv55" podStartSLOduration=3.440326164 podStartE2EDuration="23.172201061s" totalImagesPullingTime="19.731874897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:47.172037359 +0000 UTC m=+23.759798953" watchObservedRunningTime="2026-09-16 08:57:47.172201061 +0000 UTC m=+23.759962657" Sep 16 08:57:47.187342 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:47.187272 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-124.ec2.internal" podStartSLOduration=22.187249262 podStartE2EDuration="22.187249262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:47.186941737 +0000 UTC m=+23.774703330" watchObservedRunningTime="2026-09-16 08:57:47.187249262 +0000 UTC m=+23.775010860" Sep 16 08:57:47.838760 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:47.838652 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T08:57:46.877249516Z","UUID":"3984aa16-e27e-44df-8001-81cdc99e0ab0","Handler":null,"Name":"","Endpoint":""} Sep 16 08:57:47.840429 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:47.840406 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 16 08:57:47.840602 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:47.840441 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 16 08:57:47.911486 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:47.911446 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:47.911685 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:47.911583 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:48.165886 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:48.165788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" event={"ID":"76e47c12-fba9-481a-8e21-70292e3fdb0f","Type":"ContainerStarted","Data":"bffe480e449fefa7e09f8e4a8b0b6f055727d8ddcd61f7f1d3f9bdbd05c7deff"} Sep 16 08:57:48.911123 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:48.911090 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:48.911455 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:48.911222 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:48.911455 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:48.911259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:48.911455 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:48.911394 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:49.171004 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:49.170926 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" event={"ID":"315954c2-e444-46f9-bd36-2ff1648805c8","Type":"ContainerStarted","Data":"710fd8bf97857f3c9b3d675b55e2b354d27416a0c89089cdf08d5fa8bf6138c0"} Sep 16 08:57:49.910793 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:49.910748 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:49.911022 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:49.910907 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:50.910955 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:50.910919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:50.911415 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:50.910915 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:50.911415 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:50.911090 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:50.911415 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:50.911116 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:50.970017 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:50.969975 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:50.970603 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:50.970581 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:50.991800 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:50.991741 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cv529" podStartSLOduration=4.498183161 podStartE2EDuration="26.991725996s" totalImagesPullingTime="22.493542835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:49.191933989 +0000 UTC m=+25.779695583" watchObservedRunningTime="2026-09-16 08:57:50.991725996 +0000 UTC m=+27.579487593" Sep 16 08:57:51.911300 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:51.911010 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:51.911721 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:51.911373 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:52.181100 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:52.181010 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" event={"ID":"76e47c12-fba9-481a-8e21-70292e3fdb0f","Type":"ContainerStarted","Data":"47fb15172d12d675e6df22881838e588c734b959c83179654afa88d07be60862"} Sep 16 08:57:52.181387 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:52.181357 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:52.185153 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:52.185126 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55" containerID="11f6134bdc90f5d9b9cfa72fff84c30dbb0a39a9bb5e429cf997cf80e120a253" exitCode=0 Sep 16 08:57:52.185289 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:52.185158 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" event={"ID":"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55","Type":"ContainerDied","Data":"11f6134bdc90f5d9b9cfa72fff84c30dbb0a39a9bb5e429cf997cf80e120a253"} Sep 16 08:57:52.197400 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:52.197379 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:52.211582 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:52.211536 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" podStartSLOduration=8.443454752 podStartE2EDuration="28.211521092s" totalImagesPullingTime="19.76806634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:57:52.211073362 +0000 UTC m=+28.798834965" watchObservedRunningTime="2026-09-16 08:57:52.211521092 +0000 UTC m=+28.799282685" Sep 16 08:57:52.911734 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:52.911603 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:52.911734 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:52.911659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:52.912318 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:52.911777 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:52.912318 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:52.911931 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:53.149265 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.149224 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5pfmn"] Sep 16 08:57:53.149415 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.149365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:53.149508 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:53.149483 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:53.153229 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.153188 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j6g7d"] Sep 16 08:57:53.153748 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.153725 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t4hbk"] Sep 16 08:57:53.187658 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.187576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:53.187820 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.187583 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:53.187820 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:53.187716 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:53.187820 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:53.187768 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:53.188144 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.188126 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:53.188231 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.188220 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:53.203244 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.203218 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:57:53.895506 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.895257 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:53.895705 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.895604 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 16 08:57:53.896640 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:53.896374 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9bl8v" Sep 16 08:57:54.191859 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:54.191780 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55" containerID="93d07c56642c59cc6906060acb43fca57082fe630e5fd8ffe9e34064e05ed755" exitCode=0 Sep 16 08:57:54.192451 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:54.191878 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" event={"ID":"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55","Type":"ContainerDied","Data":"93d07c56642c59cc6906060acb43fca57082fe630e5fd8ffe9e34064e05ed755"} Sep 16 08:57:54.911160 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:54.911115 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:54.911160 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:54.911151 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:54.911413 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:54.911169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:54.911413 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:54.911244 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:54.911413 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:54.911399 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:54.911563 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:54.911493 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:56.200254 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:56.200222 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55" containerID="9c44f1a95348441222dcdbcd8041d85ad54114dbb802acdd94a62deb4f9f7ec5" exitCode=0 Sep 16 08:57:56.200741 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:56.200273 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" event={"ID":"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55","Type":"ContainerDied","Data":"9c44f1a95348441222dcdbcd8041d85ad54114dbb802acdd94a62deb4f9f7ec5"} Sep 16 08:57:56.639999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:56.639901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:56.639999 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:56.639965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:56.640202 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.640071 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:56.640202 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.640104 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:56.640202 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.640149 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs podName:31a3ae67-af83-4267-bb9d-6d217a293b3a nodeName:}" failed. No retries permitted until 2026-09-16 08:58:28.640127569 +0000 UTC m=+65.227889165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs") pod "network-metrics-daemon-t4hbk" (UID: "31a3ae67-af83-4267-bb9d-6d217a293b3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 16 08:57:56.640202 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.640170 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret podName:cc8d5aba-2ac1-4322-8953-92b305aedbe4 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:28.640160674 +0000 UTC m=+65.227922248 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret") pod "global-pull-secret-syncer-5pfmn" (UID: "cc8d5aba-2ac1-4322-8953-92b305aedbe4") : object "kube-system"/"original-pull-secret" not registered Sep 16 08:57:56.740691 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:56.740650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:56.740891 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.740843 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 16 08:57:56.740977 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.740897 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 16 08:57:56.740977 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.740912 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xstfp for pod openshift-network-diagnostics/network-check-target-j6g7d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:56.741054 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.740979 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp podName:eb92dc39-94de-4878-8934-3ba5387f3c55 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:28.740961789 +0000 UTC m=+65.328723366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xstfp" (UniqueName: "kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp") pod "network-check-target-j6g7d" (UID: "eb92dc39-94de-4878-8934-3ba5387f3c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 16 08:57:56.911495 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:56.911402 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:56.911495 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:56.911428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:56.911495 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:56.911427 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:56.911763 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.911528 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:56.911763 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.911595 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:56.911763 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:56.911688 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:57:58.911414 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:58.911378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:57:58.911949 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:58.911378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:57:58.911949 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:58.911490 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:57:58.911949 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:58.911587 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:57:58.911949 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:57:58.911392 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:57:58.911949 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:57:58.911717 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:58:00.910821 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:00.910730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:00.911167 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:00.910749 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:00.911167 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:00.910852 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:00.911167 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:00.910848 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:58:00.911167 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:00.910934 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:58:00.911167 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:00.911012 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:58:01.215601 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:01.215522 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55" containerID="99373602e0b6076c46b67538384070c2f01edc0c0444a4e879298dafad44444d" exitCode=0 Sep 16 08:58:01.215601 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:01.215565 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" event={"ID":"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55","Type":"ContainerDied","Data":"99373602e0b6076c46b67538384070c2f01edc0c0444a4e879298dafad44444d"} Sep 16 08:58:02.221321 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:02.221126 2564 generic.go:356] "Generic (PLEG): container finished" podID="f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55" containerID="8c5d2893053457e343b48fe9a986cf8a18aab6c4f34532428efea80b54ea80cd" exitCode=0 Sep 16 08:58:02.221678 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:02.221199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" event={"ID":"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55","Type":"ContainerDied","Data":"8c5d2893053457e343b48fe9a986cf8a18aab6c4f34532428efea80b54ea80cd"} Sep 16 08:58:02.911089 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:02.911038 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:02.911089 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:02.911081 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:02.911340 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:02.911081 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:02.911340 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:02.911155 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:58:02.911340 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:02.911262 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:58:02.911499 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:02.911366 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:58:03.226738 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:03.226699 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" event={"ID":"f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55","Type":"ContainerStarted","Data":"07629b3c8f75a2f55244e3a47bb8b3e360fd80792a2cf309ff23f37de581db81"} Sep 16 08:58:03.252654 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:03.252585 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tq7ss" podStartSLOduration=7.684664375 podStartE2EDuration="39.252569424s" totalImagesPullingTime="31.567905049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:03.252413864 +0000 UTC m=+39.840175460" watchObservedRunningTime="2026-09-16 08:58:03.252569424 +0000 UTC m=+39.840331018" Sep 16 08:58:04.911061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:04.911022 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:04.911061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:04.911053 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:04.911466 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:04.911154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:04.911466 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:04.911153 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:58:04.911466 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:04.911251 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:58:04.911466 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:04.911311 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:58:06.910811 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:06.910774 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:06.910811 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:06.910815 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:06.911352 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:06.910822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:06.911352 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:06.910912 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:58:06.911352 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:06.910973 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:58:06.911352 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:06.911034 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:58:08.911251 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:08.911210 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:08.911251 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:08.911239 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:08.911771 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:08.911312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:08.911771 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:08.911327 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:58:08.911771 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:08.911433 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:58:08.911771 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:08.911508 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:58:10.910611 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:10.910572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:10.911022 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:10.910675 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:10.911022 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:10.910684 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:58:10.911022 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:10.910709 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:10.911022 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:10.910784 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:58:10.911022 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:10.910851 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:58:12.911331 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:12.911291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:12.911778 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:12.911297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:12.911778 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:12.911386 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5pfmn" podUID="cc8d5aba-2ac1-4322-8953-92b305aedbe4" Sep 16 08:58:12.911778 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:12.911401 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:12.911778 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:12.911469 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j6g7d" podUID="eb92dc39-94de-4878-8934-3ba5387f3c55" Sep 16 08:58:12.911778 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:12.911561 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t4hbk" podUID="31a3ae67-af83-4267-bb9d-6d217a293b3a" Sep 16 08:58:13.685836 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.685808 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-124.ec2.internal" event="NodeReady" Sep 16 08:58:13.686011 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.685945 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 16 08:58:13.720015 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.719939 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68788df9d5-n8bpq"] Sep 16 08:58:13.735783 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.735745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.736669 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.736602 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68788df9d5-n8bpq"] Sep 16 08:58:13.737419 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.737396 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wvcw2"] Sep 16 08:58:13.738835 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.738803 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 16 08:58:13.738986 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.738880 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-66sx6\"" Sep 16 08:58:13.739128 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.739108 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 16 08:58:13.739228 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.739184 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 16 08:58:13.746669 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.746643 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 16 08:58:13.749760 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.749740 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mx9qq"] Sep 16 08:58:13.749912 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.749891 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.752581 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.752562 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m2g2x\"" Sep 16 08:58:13.752676 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.752599 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 16 08:58:13.752676 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.752654 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 16 08:58:13.771827 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.771807 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wvcw2"] Sep 16 08:58:13.771944 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.771838 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mx9qq"] Sep 16 08:58:13.772021 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.771941 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mx9qq" Sep 16 08:58:13.774651 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.774636 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 16 08:58:13.774740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.774718 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 16 08:58:13.774740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.774725 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7nf4x\"" Sep 16 08:58:13.774740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.774734 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 16 08:58:13.862165 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9604391-4c7a-42d5-81d3-1ded390ab580-config-volume\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.862343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9604391-4c7a-42d5-81d3-1ded390ab580-metrics-tls\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.862343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862214 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-image-registry-private-configuration\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.862343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-registry-certificates\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.862343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-installation-pull-secrets\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.862343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpk56\" (UniqueName: \"kubernetes.io/projected/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-kube-api-access-xpk56\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.862555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-bound-sa-token\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.862555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/964bb478-00a2-4671-95ef-4f9164029b79-cert\") pod \"ingress-canary-mx9qq\" (UID: \"964bb478-00a2-4671-95ef-4f9164029b79\") " pod="openshift-ingress-canary/ingress-canary-mx9qq" Sep 16 08:58:13.862555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862379 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zzwb\" (UniqueName: \"kubernetes.io/projected/964bb478-00a2-4671-95ef-4f9164029b79-kube-api-access-4zzwb\") pod \"ingress-canary-mx9qq\" (UID: \"964bb478-00a2-4671-95ef-4f9164029b79\") " pod="openshift-ingress-canary/ingress-canary-mx9qq" Sep 16 08:58:13.862555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzzv8\" (UniqueName: \"kubernetes.io/projected/c9604391-4c7a-42d5-81d3-1ded390ab580-kube-api-access-kzzv8\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.862555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9604391-4c7a-42d5-81d3-1ded390ab580-tmp-dir\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.862555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-registry-tls\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.862555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-trusted-ca\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.862555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.862547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-ca-trust-extracted\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.963724 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9604391-4c7a-42d5-81d3-1ded390ab580-config-volume\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.963724 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9604391-4c7a-42d5-81d3-1ded390ab580-metrics-tls\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-image-registry-private-configuration\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-registry-certificates\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-installation-pull-secrets\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963891 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpk56\" (UniqueName: \"kubernetes.io/projected/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-kube-api-access-xpk56\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-bound-sa-token\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/964bb478-00a2-4671-95ef-4f9164029b79-cert\") pod \"ingress-canary-mx9qq\" (UID: \"964bb478-00a2-4671-95ef-4f9164029b79\") " pod="openshift-ingress-canary/ingress-canary-mx9qq" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zzwb\" (UniqueName: \"kubernetes.io/projected/964bb478-00a2-4671-95ef-4f9164029b79-kube-api-access-4zzwb\") pod \"ingress-canary-mx9qq\" (UID: \"964bb478-00a2-4671-95ef-4f9164029b79\") " pod="openshift-ingress-canary/ingress-canary-mx9qq" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.963994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzzv8\" (UniqueName: \"kubernetes.io/projected/c9604391-4c7a-42d5-81d3-1ded390ab580-kube-api-access-kzzv8\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.964033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9604391-4c7a-42d5-81d3-1ded390ab580-tmp-dir\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.964056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-registry-tls\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.964098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-trusted-ca\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.964127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-ca-trust-extracted\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964882 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.964395 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c9604391-4c7a-42d5-81d3-1ded390ab580-config-volume\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.964882 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.964583 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-ca-trust-extracted\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964882 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.964732 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-registry-certificates\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.964882 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.964765 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9604391-4c7a-42d5-81d3-1ded390ab580-tmp-dir\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.965415 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.965391 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-trusted-ca\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.968288 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.968262 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-registry-tls\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.968391 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.968314 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-installation-pull-secrets\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.968391 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.968322 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9604391-4c7a-42d5-81d3-1ded390ab580-metrics-tls\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:13.968391 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.968355 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/964bb478-00a2-4671-95ef-4f9164029b79-cert\") pod \"ingress-canary-mx9qq\" (UID: \"964bb478-00a2-4671-95ef-4f9164029b79\") " pod="openshift-ingress-canary/ingress-canary-mx9qq" Sep 16 08:58:13.968492 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.968389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-image-registry-private-configuration\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.972542 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.972479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-bound-sa-token\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.972768 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.972750 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpk56\" (UniqueName: \"kubernetes.io/projected/03c6f49b-7f7b-4a6c-b524-8629f517d8b5-kube-api-access-xpk56\") pod \"image-registry-68788df9d5-n8bpq\" (UID: \"03c6f49b-7f7b-4a6c-b524-8629f517d8b5\") " pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:13.972909 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.972888 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zzwb\" (UniqueName: \"kubernetes.io/projected/964bb478-00a2-4671-95ef-4f9164029b79-kube-api-access-4zzwb\") pod \"ingress-canary-mx9qq\" (UID: \"964bb478-00a2-4671-95ef-4f9164029b79\") " pod="openshift-ingress-canary/ingress-canary-mx9qq" Sep 16 08:58:13.973126 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:13.973112 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzzv8\" (UniqueName: \"kubernetes.io/projected/c9604391-4c7a-42d5-81d3-1ded390ab580-kube-api-access-kzzv8\") pod \"dns-default-wvcw2\" (UID: \"c9604391-4c7a-42d5-81d3-1ded390ab580\") " pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:14.046772 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.046736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:14.058917 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.058880 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:14.079847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.079826 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mx9qq" Sep 16 08:58:14.376034 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.375994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68788df9d5-n8bpq"] Sep 16 08:58:14.379305 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:14.379281 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c6f49b_7f7b_4a6c_b524_8629f517d8b5.slice/crio-cb5ff3af34d4db28acc6f4cb010c44183d47845ad956e99b14766b666218cbc9 WatchSource:0}: Error finding container cb5ff3af34d4db28acc6f4cb010c44183d47845ad956e99b14766b666218cbc9: Status 404 returned error can't find the container with id cb5ff3af34d4db28acc6f4cb010c44183d47845ad956e99b14766b666218cbc9 Sep 16 08:58:14.391583 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.391558 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wvcw2"] Sep 16 08:58:14.394223 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:14.394201 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9604391_4c7a_42d5_81d3_1ded390ab580.slice/crio-4f7d56a49f7e9257d73db2d9523d7dc6d8eb7fc30eb72afdd8e7edb73182b980 WatchSource:0}: Error finding container 4f7d56a49f7e9257d73db2d9523d7dc6d8eb7fc30eb72afdd8e7edb73182b980: Status 404 returned error can't find the container with id 4f7d56a49f7e9257d73db2d9523d7dc6d8eb7fc30eb72afdd8e7edb73182b980 Sep 16 08:58:14.430122 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.430096 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mx9qq"] Sep 16 08:58:14.432925 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:14.432899 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964bb478_00a2_4671_95ef_4f9164029b79.slice/crio-bff7b9546b0b618a2a7aa355acdcb28001177e9ab934128265a5a5e4088982a9 WatchSource:0}: Error finding container bff7b9546b0b618a2a7aa355acdcb28001177e9ab934128265a5a5e4088982a9: Status 404 returned error can't find the container with id bff7b9546b0b618a2a7aa355acdcb28001177e9ab934128265a5a5e4088982a9 Sep 16 08:58:14.911087 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.911048 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:14.911269 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.911097 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:14.911269 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.911097 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:14.915270 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.915040 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 08:58:14.915270 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.915097 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dlm4w\"" Sep 16 08:58:14.915270 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.915102 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 08:58:14.915270 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.915100 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 08:58:14.915270 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.915049 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 08:58:14.915270 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:14.915107 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gqxmz\"" Sep 16 08:58:15.255176 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:15.255083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wvcw2" event={"ID":"c9604391-4c7a-42d5-81d3-1ded390ab580","Type":"ContainerStarted","Data":"4f7d56a49f7e9257d73db2d9523d7dc6d8eb7fc30eb72afdd8e7edb73182b980"} Sep 16 08:58:15.257637 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:15.257509 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" event={"ID":"03c6f49b-7f7b-4a6c-b524-8629f517d8b5","Type":"ContainerStarted","Data":"bb0fe98d110c9131c072cf4e04fa27c809b1779bdb08ce4dc3bbe3982ae5e973"} Sep 16 08:58:15.257637 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:15.257583 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:15.257637 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:15.257605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" event={"ID":"03c6f49b-7f7b-4a6c-b524-8629f517d8b5","Type":"ContainerStarted","Data":"cb5ff3af34d4db28acc6f4cb010c44183d47845ad956e99b14766b666218cbc9"} Sep 16 08:58:15.259311 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:15.259282 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mx9qq" event={"ID":"964bb478-00a2-4671-95ef-4f9164029b79","Type":"ContainerStarted","Data":"bff7b9546b0b618a2a7aa355acdcb28001177e9ab934128265a5a5e4088982a9"} Sep 16 08:58:15.279407 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:15.279346 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" podStartSLOduration=3.279325911 podStartE2EDuration="3.279325911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:15.277121034 +0000 UTC m=+51.864882641" watchObservedRunningTime="2026-09-16 08:58:15.279325911 +0000 UTC m=+51.867087505" Sep 16 08:58:17.266508 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:17.266416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mx9qq" event={"ID":"964bb478-00a2-4671-95ef-4f9164029b79","Type":"ContainerStarted","Data":"5730cfb0581164972fe54e99bb922ee77ced7c2dc91f5dafb1231a957246e7e9"} Sep 16 08:58:17.268348 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:17.268326 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wvcw2" event={"ID":"c9604391-4c7a-42d5-81d3-1ded390ab580","Type":"ContainerStarted","Data":"9d77d9fdf4874a441e6c84cf1f042fb7169ebc921167ac2e13b41cec95d46377"} Sep 16 08:58:17.268459 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:17.268364 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wvcw2" event={"ID":"c9604391-4c7a-42d5-81d3-1ded390ab580","Type":"ContainerStarted","Data":"2fad9c605581385ef11232d0f3400a6af76ff53fd8a4176b018813300f5d829b"} Sep 16 08:58:17.268503 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:17.268476 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:17.282880 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:17.282813 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mx9qq" podStartSLOduration=1.685501779 podStartE2EDuration="4.282794536s" totalImagesPullingTime="2.597292757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:17.28166997 +0000 UTC m=+53.869431564" watchObservedRunningTime="2026-09-16 08:58:17.282794536 +0000 UTC m=+53.870556130" Sep 16 08:58:17.300251 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:17.300209 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wvcw2" podStartSLOduration=1.685051215 podStartE2EDuration="4.300194044s" totalImagesPullingTime="2.615142829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:17.299457807 +0000 UTC m=+53.887219401" watchObservedRunningTime="2026-09-16 08:58:17.300194044 +0000 UTC m=+53.887955638" Sep 16 08:58:20.644624 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:20.644589 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9"] Sep 16 08:58:20.646874 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:20.646847 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" Sep 16 08:58:20.649226 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:20.649204 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 16 08:58:20.649323 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:20.649267 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xzjmx\"" Sep 16 08:58:20.656350 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:20.656327 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9"] Sep 16 08:58:20.813807 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:20.813766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8805bcef-2383-4829-8a97-8cbad8aa3e06-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-vsrk9\" (UID: \"8805bcef-2383-4829-8a97-8cbad8aa3e06\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" Sep 16 08:58:20.915199 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:20.915131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8805bcef-2383-4829-8a97-8cbad8aa3e06-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-vsrk9\" (UID: \"8805bcef-2383-4829-8a97-8cbad8aa3e06\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" Sep 16 08:58:20.918227 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:20.918202 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8805bcef-2383-4829-8a97-8cbad8aa3e06-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-vsrk9\" (UID: \"8805bcef-2383-4829-8a97-8cbad8aa3e06\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" Sep 16 08:58:20.954851 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:20.954822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" Sep 16 08:58:21.225546 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.225442 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9"] Sep 16 08:58:21.229580 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:21.229549 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8805bcef_2383_4829_8a97_8cbad8aa3e06.slice/crio-dcfa66febab503ae437ee5e65464fd40fc0408e86adecf7cb2515ae58963992d WatchSource:0}: Error finding container dcfa66febab503ae437ee5e65464fd40fc0408e86adecf7cb2515ae58963992d: Status 404 returned error can't find the container with id dcfa66febab503ae437ee5e65464fd40fc0408e86adecf7cb2515ae58963992d Sep 16 08:58:21.280365 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.280327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" event={"ID":"8805bcef-2383-4829-8a97-8cbad8aa3e06","Type":"ContainerStarted","Data":"dcfa66febab503ae437ee5e65464fd40fc0408e86adecf7cb2515ae58963992d"} Sep 16 08:58:21.421886 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.421832 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-4c4b4"] Sep 16 08:58:21.424105 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.424088 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-4c4b4" Sep 16 08:58:21.426447 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.426423 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 16 08:58:21.426447 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.426452 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 16 08:58:21.426617 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.426544 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zblgr\"" Sep 16 08:58:21.434684 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.434662 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-4c4b4"] Sep 16 08:58:21.620530 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.620499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qxpb\" (UniqueName: \"kubernetes.io/projected/05a40bab-9902-4913-8310-2d5ed4271fdd-kube-api-access-7qxpb\") pod \"downloads-76f99584f4-4c4b4\" (UID: \"05a40bab-9902-4913-8310-2d5ed4271fdd\") " pod="openshift-console/downloads-76f99584f4-4c4b4" Sep 16 08:58:21.721434 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.721398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qxpb\" (UniqueName: \"kubernetes.io/projected/05a40bab-9902-4913-8310-2d5ed4271fdd-kube-api-access-7qxpb\") pod \"downloads-76f99584f4-4c4b4\" (UID: \"05a40bab-9902-4913-8310-2d5ed4271fdd\") " pod="openshift-console/downloads-76f99584f4-4c4b4" Sep 16 08:58:21.730497 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.730470 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qxpb\" (UniqueName: \"kubernetes.io/projected/05a40bab-9902-4913-8310-2d5ed4271fdd-kube-api-access-7qxpb\") pod \"downloads-76f99584f4-4c4b4\" (UID: \"05a40bab-9902-4913-8310-2d5ed4271fdd\") " pod="openshift-console/downloads-76f99584f4-4c4b4" Sep 16 08:58:21.733095 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.733070 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-4c4b4" Sep 16 08:58:21.809427 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.809393 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mtvjs"] Sep 16 08:58:21.811568 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.811549 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:21.814509 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.814185 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 16 08:58:21.814509 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.814347 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rxs8r\"" Sep 16 08:58:21.814509 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.814376 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 16 08:58:21.814693 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.814604 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 16 08:58:21.814693 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.814603 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 16 08:58:21.824101 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.824080 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mtvjs"] Sep 16 08:58:21.923008 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.922932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-crio-socket\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:21.923008 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.922970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:21.923223 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.923018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-data-volume\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:21.923223 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.923048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:21.923223 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:21.923077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhsqg\" (UniqueName: \"kubernetes.io/projected/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-api-access-nhsqg\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.005002 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.004953 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-4c4b4"] Sep 16 08:58:22.008224 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:22.008195 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a40bab_9902_4913_8310_2d5ed4271fdd.slice/crio-bbd2069692cc229ab9b639fc7e71b4be6190a40f927954ddcef86704891a40f8 WatchSource:0}: Error finding container bbd2069692cc229ab9b639fc7e71b4be6190a40f927954ddcef86704891a40f8: Status 404 returned error can't find the container with id bbd2069692cc229ab9b639fc7e71b4be6190a40f927954ddcef86704891a40f8 Sep 16 08:58:22.023616 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.023588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-crio-socket\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.023769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.023625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.023769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.023668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-data-volume\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.023769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.023697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.023769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.023726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhsqg\" (UniqueName: \"kubernetes.io/projected/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-api-access-nhsqg\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.023769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.023733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-crio-socket\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.024043 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:22.023747 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 08:58:22.024043 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:22.023841 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 08:58:22.024043 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:22.023978 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm podName:8bf5749e-a5dd-4611-ad9e-f7f551f3b016 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:22.523955142 +0000 UTC m=+59.111716738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mtvjs" (UID: "8bf5749e-a5dd-4611-ad9e-f7f551f3b016") : configmap "kube-rbac-proxy" not found Sep 16 08:58:22.024043 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:22.024004 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls podName:8bf5749e-a5dd-4611-ad9e-f7f551f3b016 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:22.523994089 +0000 UTC m=+59.111755663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mtvjs" (UID: "8bf5749e-a5dd-4611-ad9e-f7f551f3b016") : secret "insights-runtime-extractor-tls" not found Sep 16 08:58:22.024203 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.024116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-data-volume\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.031716 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.031691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhsqg\" (UniqueName: \"kubernetes.io/projected/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-api-access-nhsqg\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.283845 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.283772 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-4c4b4" event={"ID":"05a40bab-9902-4913-8310-2d5ed4271fdd","Type":"ContainerStarted","Data":"bbd2069692cc229ab9b639fc7e71b4be6190a40f927954ddcef86704891a40f8"} Sep 16 08:58:22.528263 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.528226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.528263 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:22.528265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:22.528463 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:22.528357 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 08:58:22.528463 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:22.528376 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 08:58:22.528463 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:22.528421 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm podName:8bf5749e-a5dd-4611-ad9e-f7f551f3b016 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:23.52840569 +0000 UTC m=+60.116167266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mtvjs" (UID: "8bf5749e-a5dd-4611-ad9e-f7f551f3b016") : configmap "kube-rbac-proxy" not found Sep 16 08:58:22.528463 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:22.528434 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls podName:8bf5749e-a5dd-4611-ad9e-f7f551f3b016 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:23.528428388 +0000 UTC m=+60.116189960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mtvjs" (UID: "8bf5749e-a5dd-4611-ad9e-f7f551f3b016") : secret "insights-runtime-extractor-tls" not found Sep 16 08:58:23.178586 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.178553 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wvcw2_c9604391-4c7a-42d5-81d3-1ded390ab580/dns/0.log" Sep 16 08:58:23.288994 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.288964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" event={"ID":"8805bcef-2383-4829-8a97-8cbad8aa3e06","Type":"ContainerStarted","Data":"233cac9403c072aa74f0c7a106ecab7cde4d23447f28a97ca81cab4ab14e878f"} Sep 16 08:58:23.289486 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.289374 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" Sep 16 08:58:23.294690 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.294662 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" Sep 16 08:58:23.304809 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.304763 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-vsrk9" podStartSLOduration=2.233265997 podStartE2EDuration="3.30474699s" totalImagesPullingTime="1.071480993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:23.304010347 +0000 UTC m=+59.891771942" watchObservedRunningTime="2026-09-16 08:58:23.30474699 +0000 UTC m=+59.892508584" Sep 16 08:58:23.352142 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.352099 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wvcw2_c9604391-4c7a-42d5-81d3-1ded390ab580/kube-rbac-proxy/0.log" Sep 16 08:58:23.537063 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.536978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:23.537063 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.537032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:23.537290 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:23.537102 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 08:58:23.537290 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:23.537195 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 08:58:23.537290 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:23.537269 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm podName:8bf5749e-a5dd-4611-ad9e-f7f551f3b016 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:25.537245322 +0000 UTC m=+62.125006913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mtvjs" (UID: "8bf5749e-a5dd-4611-ad9e-f7f551f3b016") : configmap "kube-rbac-proxy" not found Sep 16 08:58:23.537408 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:23.537293 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls podName:8bf5749e-a5dd-4611-ad9e-f7f551f3b016 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:25.537282373 +0000 UTC m=+62.125043987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mtvjs" (UID: "8bf5749e-a5dd-4611-ad9e-f7f551f3b016") : secret "insights-runtime-extractor-tls" not found Sep 16 08:58:23.551372 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.551347 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2zmb2_803c1e19-d9f2-4864-93b1-1e047384c829/dns-node-resolver/0.log" Sep 16 08:58:23.736532 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.736499 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-898qg"] Sep 16 08:58:23.752914 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.752883 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-898qg"] Sep 16 08:58:23.753075 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.752973 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.755813 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.755785 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 16 08:58:23.755981 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.755898 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 16 08:58:23.757311 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.757135 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 16 08:58:23.757311 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.757148 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 16 08:58:23.757311 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.757172 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 16 08:58:23.757311 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.757249 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n5khc\"" Sep 16 08:58:23.838916 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.838820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b5d785e-d342-433b-94c7-29503c9c9a95-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.838916 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.838904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d785e-d342-433b-94c7-29503c9c9a95-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.839112 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.838940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2fjm\" (UniqueName: \"kubernetes.io/projected/8b5d785e-d342-433b-94c7-29503c9c9a95-kube-api-access-n2fjm\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.839112 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.839050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b5d785e-d342-433b-94c7-29503c9c9a95-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.939723 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.939682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b5d785e-d342-433b-94c7-29503c9c9a95-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.939922 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.939743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d785e-d342-433b-94c7-29503c9c9a95-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.939922 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.939770 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2fjm\" (UniqueName: \"kubernetes.io/projected/8b5d785e-d342-433b-94c7-29503c9c9a95-kube-api-access-n2fjm\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.939922 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.939809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b5d785e-d342-433b-94c7-29503c9c9a95-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.942511 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.942486 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 16 08:58:23.942632 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.942486 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 16 08:58:23.942632 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.942585 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 16 08:58:23.947883 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.947851 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 16 08:58:23.950810 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:23.950784 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 16 08:58:23.950917 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:23.950852 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5d785e-d342-433b-94c7-29503c9c9a95-prometheus-operator-tls podName:8b5d785e-d342-433b-94c7-29503c9c9a95 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:24.45083284 +0000 UTC m=+61.038594415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8b5d785e-d342-433b-94c7-29503c9c9a95-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-898qg" (UID: "8b5d785e-d342-433b-94c7-29503c9c9a95") : secret "prometheus-operator-tls" not found Sep 16 08:58:23.951414 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.951391 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b5d785e-d342-433b-94c7-29503c9c9a95-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.953124 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.953095 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b5d785e-d342-433b-94c7-29503c9c9a95-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:23.958587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.958568 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 16 08:58:23.969225 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:23.969202 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2fjm\" (UniqueName: \"kubernetes.io/projected/8b5d785e-d342-433b-94c7-29503c9c9a95-kube-api-access-n2fjm\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:24.151662 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:24.151623 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68788df9d5-n8bpq_03c6f49b-7f7b-4a6c-b524-8629f517d8b5/registry/0.log" Sep 16 08:58:24.545677 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:24.545594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d785e-d342-433b-94c7-29503c9c9a95-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:24.548583 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:24.548551 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d785e-d342-433b-94c7-29503c9c9a95-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-898qg\" (UID: \"8b5d785e-d342-433b-94c7-29503c9c9a95\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:24.552101 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:24.552076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8w9m4_883084df-acfa-46a3-8843-f8cd215214e0/node-ca/0.log" Sep 16 08:58:24.666022 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:24.665994 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n5khc\"" Sep 16 08:58:24.674351 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:24.674318 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" Sep 16 08:58:24.946989 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:24.946712 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-898qg"] Sep 16 08:58:24.949454 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:24.949422 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5d785e_d342_433b_94c7_29503c9c9a95.slice/crio-639750325b675dd134b205742fbbb60cabfa745c9935615267a4bccdb3ebb82a WatchSource:0}: Error finding container 639750325b675dd134b205742fbbb60cabfa745c9935615267a4bccdb3ebb82a: Status 404 returned error can't find the container with id 639750325b675dd134b205742fbbb60cabfa745c9935615267a4bccdb3ebb82a Sep 16 08:58:25.204283 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.204214 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtwpg" Sep 16 08:58:25.297553 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.297453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" event={"ID":"8b5d785e-d342-433b-94c7-29503c9c9a95","Type":"ContainerStarted","Data":"639750325b675dd134b205742fbbb60cabfa745c9935615267a4bccdb3ebb82a"} Sep 16 08:58:25.529438 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.529358 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f587ccd55-hnn7g"] Sep 16 08:58:25.531390 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.531362 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.535898 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.535850 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 16 08:58:25.536038 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.535939 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 16 08:58:25.536038 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.535856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 16 08:58:25.536215 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.536197 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d4cbb\"" Sep 16 08:58:25.536273 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.536226 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 16 08:58:25.536987 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.536959 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 16 08:58:25.544725 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.544703 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f587ccd55-hnn7g"] Sep 16 08:58:25.553650 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.553623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-config\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.554106 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.553666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfxnk\" (UniqueName: \"kubernetes.io/projected/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-kube-api-access-wfxnk\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.554106 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.553997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:25.554106 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.554080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-oauth-config\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.554260 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.554124 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-service-ca\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.554260 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.554204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-serving-cert\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.554260 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.554245 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:25.554401 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.554294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-oauth-serving-cert\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.554532 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:25.554513 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 16 08:58:25.554618 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:25.554606 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls podName:8bf5749e-a5dd-4611-ad9e-f7f551f3b016 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:29.554583378 +0000 UTC m=+66.142344965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mtvjs" (UID: "8bf5749e-a5dd-4611-ad9e-f7f551f3b016") : secret "insights-runtime-extractor-tls" not found Sep 16 08:58:25.554693 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:25.554636 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 16 08:58:25.554994 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:25.554978 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm podName:8bf5749e-a5dd-4611-ad9e-f7f551f3b016 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:29.554959189 +0000 UTC m=+66.142720775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mtvjs" (UID: "8bf5749e-a5dd-4611-ad9e-f7f551f3b016") : configmap "kube-rbac-proxy" not found Sep 16 08:58:25.555590 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.555571 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mx9qq_964bb478-00a2-4671-95ef-4f9164029b79/serve-healthcheck-canary/0.log" Sep 16 08:58:25.655048 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.655010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-oauth-serving-cert\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.655245 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.655076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-config\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.655245 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.655105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfxnk\" (UniqueName: \"kubernetes.io/projected/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-kube-api-access-wfxnk\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.655245 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.655192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-oauth-config\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.655245 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.655232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-service-ca\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.655461 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.655290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-serving-cert\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.656531 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.656284 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-config\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.656531 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.656336 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-oauth-serving-cert\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.656531 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.656489 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-service-ca\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.658448 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.658415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-oauth-config\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.658448 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.658447 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-serving-cert\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.663705 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.663683 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfxnk\" (UniqueName: \"kubernetes.io/projected/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-kube-api-access-wfxnk\") pod \"console-6f587ccd55-hnn7g\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:25.845309 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:25.845215 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:26.131576 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:26.131544 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f587ccd55-hnn7g"] Sep 16 08:58:26.330036 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:26.329997 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c50972c_d5d5_4c9d_ab45_e21beca0f51b.slice/crio-6d99a12a6f1646371cd414a325e78d18104d72362d5f819f3540f98b63f3019b WatchSource:0}: Error finding container 6d99a12a6f1646371cd414a325e78d18104d72362d5f819f3540f98b63f3019b: Status 404 returned error can't find the container with id 6d99a12a6f1646371cd414a325e78d18104d72362d5f819f3540f98b63f3019b Sep 16 08:58:27.273956 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:27.273922 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wvcw2" Sep 16 08:58:27.308359 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:27.308326 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" event={"ID":"8b5d785e-d342-433b-94c7-29503c9c9a95","Type":"ContainerStarted","Data":"b84ab8127b0893267df506932dc6fbc833ed34e822c70d8570abaf1215fd9376"} Sep 16 08:58:27.308528 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:27.308386 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" event={"ID":"8b5d785e-d342-433b-94c7-29503c9c9a95","Type":"ContainerStarted","Data":"4ccd543e7b762208773431a3c5c4e34c740ec116f1c64d886e0d2f336876dbe8"} Sep 16 08:58:27.309799 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:27.309770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f587ccd55-hnn7g" event={"ID":"9c50972c-d5d5-4c9d-ab45-e21beca0f51b","Type":"ContainerStarted","Data":"6d99a12a6f1646371cd414a325e78d18104d72362d5f819f3540f98b63f3019b"} Sep 16 08:58:27.343129 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:27.343072 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-898qg" podStartSLOduration=2.936080273 podStartE2EDuration="4.343052175s" totalImagesPullingTime="1.406971902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:27.342121586 +0000 UTC m=+63.929883193" watchObservedRunningTime="2026-09-16 08:58:27.343052175 +0000 UTC m=+63.930813771" Sep 16 08:58:28.684096 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.684052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:28.684534 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.684193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:28.686812 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.686769 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 16 08:58:28.686966 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.686849 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 16 08:58:28.697707 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.697676 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc8d5aba-2ac1-4322-8953-92b305aedbe4-original-pull-secret\") pod \"global-pull-secret-syncer-5pfmn\" (UID: \"cc8d5aba-2ac1-4322-8953-92b305aedbe4\") " pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:28.697707 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.697696 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31a3ae67-af83-4267-bb9d-6d217a293b3a-metrics-certs\") pod \"network-metrics-daemon-t4hbk\" (UID: \"31a3ae67-af83-4267-bb9d-6d217a293b3a\") " pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:28.725941 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.725907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5pfmn" Sep 16 08:58:28.740938 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.740910 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gqxmz\"" Sep 16 08:58:28.749087 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.749064 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t4hbk" Sep 16 08:58:28.785593 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.785563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:28.788116 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.788092 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 16 08:58:28.799028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.799002 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 16 08:58:28.810279 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:28.810226 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xstfp\" (UniqueName: \"kubernetes.io/projected/eb92dc39-94de-4878-8934-3ba5387f3c55-kube-api-access-xstfp\") pod \"network-check-target-j6g7d\" (UID: \"eb92dc39-94de-4878-8934-3ba5387f3c55\") " pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:29.035305 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.035223 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dlm4w\"" Sep 16 08:58:29.043370 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.043343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:29.099419 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.099389 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz"] Sep 16 08:58:29.103720 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.102914 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.105992 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.105960 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 16 08:58:29.106148 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.105971 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gtcmf\"" Sep 16 08:58:29.106241 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.106130 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 16 08:58:29.108477 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.108458 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn"] Sep 16 08:58:29.111280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.111256 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.113840 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.113823 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 16 08:58:29.114141 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.114120 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 16 08:58:29.114433 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.114414 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 16 08:58:29.115404 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.115242 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4thqh\"" Sep 16 08:58:29.119472 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.119302 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz"] Sep 16 08:58:29.126391 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.126365 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn"] Sep 16 08:58:29.127260 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.127238 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-64q69"] Sep 16 08:58:29.129936 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.129914 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.132493 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.132474 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 16 08:58:29.132749 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.132527 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vfdkt\"" Sep 16 08:58:29.132848 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.132752 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 16 08:58:29.132848 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.132631 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 16 08:58:29.189519 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-metrics-client-ca\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.189519 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-wtmp\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.189769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.189769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv2zs\" (UniqueName: \"kubernetes.io/projected/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-kube-api-access-kv2zs\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.189769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36b530db-d017-477d-bd7a-86a518bbc12a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.189769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.189769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-root\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.189769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.189769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-sys\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.189769 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.190216 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36b530db-d017-477d-bd7a-86a518bbc12a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.190216 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-textfile\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.190216 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36b530db-d017-477d-bd7a-86a518bbc12a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.190216 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j929z\" (UniqueName: \"kubernetes.io/projected/36b530db-d017-477d-bd7a-86a518bbc12a-kube-api-access-j929z\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.190216 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.189952 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.190216 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.190022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36b530db-d017-477d-bd7a-86a518bbc12a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.190216 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.190145 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsj9h\" (UniqueName: \"kubernetes.io/projected/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-kube-api-access-bsj9h\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.190563 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.190223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36b530db-d017-477d-bd7a-86a518bbc12a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.190563 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.190249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-tls\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.291741 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36b530db-d017-477d-bd7a-86a518bbc12a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.291741 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-textfile\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.291741 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36b530db-d017-477d-bd7a-86a518bbc12a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.292051 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j929z\" (UniqueName: \"kubernetes.io/projected/36b530db-d017-477d-bd7a-86a518bbc12a-kube-api-access-j929z\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.292051 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.292051 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36b530db-d017-477d-bd7a-86a518bbc12a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.292051 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsj9h\" (UniqueName: \"kubernetes.io/projected/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-kube-api-access-bsj9h\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.292051 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36b530db-d017-477d-bd7a-86a518bbc12a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.292051 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-tls\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.292051 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.291967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-metrics-client-ca\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.292051 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-wtmp\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.292051 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.292535 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv2zs\" (UniqueName: \"kubernetes.io/projected/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-kube-api-access-kv2zs\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.292535 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36b530db-d017-477d-bd7a-86a518bbc12a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.292535 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.292535 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292131 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-textfile\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.292535 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-root\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.292535 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.292535 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-sys\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.292535 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292590 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36b530db-d017-477d-bd7a-86a518bbc12a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292602 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-wtmp\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292670 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-metrics-client-ca\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:29.292697 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292743 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-root\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292750 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36b530db-d017-477d-bd7a-86a518bbc12a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:29.292766 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-tls podName:f069bb5c-c422-4ee8-8967-9d3d947a5cbb nodeName:}" failed. No retries permitted until 2026-09-16 08:58:29.792745711 +0000 UTC m=+66.380507301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-tls") pod "node-exporter-64q69" (UID: "f069bb5c-c422-4ee8-8967-9d3d947a5cbb") : secret "node-exporter-tls" not found Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:29.292697 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292782 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:29.292806 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-openshift-state-metrics-tls podName:3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40 nodeName:}" failed. No retries permitted until 2026-09-16 08:58:29.792797137 +0000 UTC m=+66.380558710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-dwzbz" (UID: "3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40") : secret "openshift-state-metrics-tls" not found Sep 16 08:58:29.293024 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.292881 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-sys\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.293585 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.293396 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36b530db-d017-477d-bd7a-86a518bbc12a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.293585 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.293504 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.295067 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.295040 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36b530db-d017-477d-bd7a-86a518bbc12a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.295524 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.295493 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.296148 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.296127 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.296520 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.296495 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36b530db-d017-477d-bd7a-86a518bbc12a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.300806 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.300779 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j929z\" (UniqueName: \"kubernetes.io/projected/36b530db-d017-477d-bd7a-86a518bbc12a-kube-api-access-j929z\") pod \"kube-state-metrics-59fbdd77d-gnrmn\" (UID: \"36b530db-d017-477d-bd7a-86a518bbc12a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.302077 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.302044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv2zs\" (UniqueName: \"kubernetes.io/projected/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-kube-api-access-kv2zs\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.302992 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.302969 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsj9h\" (UniqueName: \"kubernetes.io/projected/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-kube-api-access-bsj9h\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.426854 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.426798 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" Sep 16 08:58:29.594399 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.594142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:29.594399 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.594239 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:29.594713 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.594691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:29.597148 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.597120 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bf5749e-a5dd-4611-ad9e-f7f551f3b016-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mtvjs\" (UID: \"8bf5749e-a5dd-4611-ad9e-f7f551f3b016\") " pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:29.625740 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.625709 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rxs8r\"" Sep 16 08:58:29.634041 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.634001 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mtvjs" Sep 16 08:58:29.796524 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.796489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-tls\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.796946 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.796541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:29.799202 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.799174 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f069bb5c-c422-4ee8-8967-9d3d947a5cbb-node-exporter-tls\") pod \"node-exporter-64q69\" (UID: \"f069bb5c-c422-4ee8-8967-9d3d947a5cbb\") " pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:29.799361 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:29.799334 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-dwzbz\" (UID: \"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:30.019130 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.019053 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" Sep 16 08:58:30.041054 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.041000 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-64q69" Sep 16 08:58:30.057407 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:30.057347 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf069bb5c_c422_4ee8_8967_9d3d947a5cbb.slice/crio-29d9df83f24c935ec5418a933a5489ea7d6ad2a44a88fd2b9cbb3d8516c0b112 WatchSource:0}: Error finding container 29d9df83f24c935ec5418a933a5489ea7d6ad2a44a88fd2b9cbb3d8516c0b112: Status 404 returned error can't find the container with id 29d9df83f24c935ec5418a933a5489ea7d6ad2a44a88fd2b9cbb3d8516c0b112 Sep 16 08:58:30.109905 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.109160 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5pfmn"] Sep 16 08:58:30.112884 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.112835 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t4hbk"] Sep 16 08:58:30.117758 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:30.117725 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8d5aba_2ac1_4322_8953_92b305aedbe4.slice/crio-799b64eb7aa41d5e180be3a17f2e8701f96e694dc9703eeb7a7adb5507e5e99f WatchSource:0}: Error finding container 799b64eb7aa41d5e180be3a17f2e8701f96e694dc9703eeb7a7adb5507e5e99f: Status 404 returned error can't find the container with id 799b64eb7aa41d5e180be3a17f2e8701f96e694dc9703eeb7a7adb5507e5e99f Sep 16 08:58:30.118316 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.118254 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mtvjs"] Sep 16 08:58:30.119180 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:30.119156 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a3ae67_af83_4267_bb9d_6d217a293b3a.slice/crio-43fe959d41223d48cbefa3d5afd7d873ac8d86994021ce53d2474568cb47aa5b WatchSource:0}: Error finding container 43fe959d41223d48cbefa3d5afd7d873ac8d86994021ce53d2474568cb47aa5b: Status 404 returned error can't find the container with id 43fe959d41223d48cbefa3d5afd7d873ac8d86994021ce53d2474568cb47aa5b Sep 16 08:58:30.121626 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:30.121588 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf5749e_a5dd_4611_ad9e_f7f551f3b016.slice/crio-b758bd35f092cf7e9757358290875c84eb6dd1e66ac6a11f2e1767ab0b45b546 WatchSource:0}: Error finding container b758bd35f092cf7e9757358290875c84eb6dd1e66ac6a11f2e1767ab0b45b546: Status 404 returned error can't find the container with id b758bd35f092cf7e9757358290875c84eb6dd1e66ac6a11f2e1767ab0b45b546 Sep 16 08:58:30.136491 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.136405 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j6g7d"] Sep 16 08:58:30.138058 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.137841 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn"] Sep 16 08:58:30.140722 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:30.140664 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb92dc39_94de_4878_8934_3ba5387f3c55.slice/crio-e2810cf40ebcc612b953038f372242e0c7efb3c3648e8798ffc3e1b5b393ecec WatchSource:0}: Error finding container e2810cf40ebcc612b953038f372242e0c7efb3c3648e8798ffc3e1b5b393ecec: Status 404 returned error can't find the container with id e2810cf40ebcc612b953038f372242e0c7efb3c3648e8798ffc3e1b5b393ecec Sep 16 08:58:30.141522 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:30.141473 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b530db_d017_477d_bd7a_86a518bbc12a.slice/crio-830b066bd698cdd66a7cb6de9c527e1a469fd19e41f371b183b21092b74f5a07 WatchSource:0}: Error finding container 830b066bd698cdd66a7cb6de9c527e1a469fd19e41f371b183b21092b74f5a07: Status 404 returned error can't find the container with id 830b066bd698cdd66a7cb6de9c527e1a469fd19e41f371b183b21092b74f5a07 Sep 16 08:58:30.173117 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.173090 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 08:58:30.177708 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.177690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.182145 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.181827 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 16 08:58:30.182145 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.182063 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 16 08:58:30.187389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.183523 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 16 08:58:30.187389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.183842 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 16 08:58:30.187389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.184083 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 16 08:58:30.187389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.184092 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 16 08:58:30.187389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.184369 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-knt8g\"" Sep 16 08:58:30.187389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.186088 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 16 08:58:30.187389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.186429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 16 08:58:30.187389 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.186829 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 16 08:58:30.193647 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.193567 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 08:58:30.200121 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200215 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200215 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-config-volume\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200215 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200193 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200387 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-config-out\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200387 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200387 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200362 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwxkp\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-kube-api-access-cwxkp\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200534 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-web-config\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200534 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200767 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200767 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200585 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200767 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.200767 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.200670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.301696 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.301658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.301696 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.301700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302060 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.301732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-config-volume\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302060 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.301759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302209 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:30.302178 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-trusted-ca-bundle podName:5265f55e-5f9a-4314-b74d-14d06458601c nodeName:}" failed. No retries permitted until 2026-09-16 08:58:30.802149964 +0000 UTC m=+67.389911549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c") : configmap references non-existent config key: ca-bundle.crt Sep 16 08:58:30.302429 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:30.302332 2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 16 08:58:30.302429 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:58:30.302393 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-main-tls podName:5265f55e-5f9a-4314-b74d-14d06458601c nodeName:}" failed. No retries permitted until 2026-09-16 08:58:30.802376709 +0000 UTC m=+67.390138294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c") : secret "alertmanager-main-tls" not found Sep 16 08:58:30.302590 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.302466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-config-out\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302590 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.302530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302590 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.302582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwxkp\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-kube-api-access-cwxkp\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302739 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.302616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-web-config\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302739 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.302653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302835 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.302742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302835 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.302785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.302835 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.302811 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.303004 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.302841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.304423 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.304062 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz"] Sep 16 08:58:30.304423 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.304191 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.304633 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.304481 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.305424 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.305367 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.306086 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.306002 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.306481 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.306458 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-config-volume\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.307591 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.307551 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-config-out\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.307990 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:30.307788 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d66e7f5_d66c_4cc8_8cc3_4628f9c57c40.slice/crio-fb93788846d7f63703b7ea23ccdad3878f8f8e0b91aa78137ff40ecc102a9c8b WatchSource:0}: Error finding container fb93788846d7f63703b7ea23ccdad3878f8f8e0b91aa78137ff40ecc102a9c8b: Status 404 returned error can't find the container with id fb93788846d7f63703b7ea23ccdad3878f8f8e0b91aa78137ff40ecc102a9c8b Sep 16 08:58:30.307990 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.307915 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.308250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.308209 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-web-config\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.308331 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.308261 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.308331 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.308274 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.313557 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.313536 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwxkp\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-kube-api-access-cwxkp\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.323813 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.323780 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtvjs" event={"ID":"8bf5749e-a5dd-4611-ad9e-f7f551f3b016","Type":"ContainerStarted","Data":"5ecef06bcd2745e4eafd2f946f6d40fc806516f9972359793a53c7b657d0d1e5"} Sep 16 08:58:30.323924 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.323834 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtvjs" event={"ID":"8bf5749e-a5dd-4611-ad9e-f7f551f3b016","Type":"ContainerStarted","Data":"b758bd35f092cf7e9757358290875c84eb6dd1e66ac6a11f2e1767ab0b45b546"} Sep 16 08:58:30.325222 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.325196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" event={"ID":"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40","Type":"ContainerStarted","Data":"fb93788846d7f63703b7ea23ccdad3878f8f8e0b91aa78137ff40ecc102a9c8b"} Sep 16 08:58:30.326705 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.326681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" event={"ID":"36b530db-d017-477d-bd7a-86a518bbc12a","Type":"ContainerStarted","Data":"830b066bd698cdd66a7cb6de9c527e1a469fd19e41f371b183b21092b74f5a07"} Sep 16 08:58:30.328274 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.328252 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64q69" event={"ID":"f069bb5c-c422-4ee8-8967-9d3d947a5cbb","Type":"ContainerStarted","Data":"29d9df83f24c935ec5418a933a5489ea7d6ad2a44a88fd2b9cbb3d8516c0b112"} Sep 16 08:58:30.329920 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.329897 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5pfmn" event={"ID":"cc8d5aba-2ac1-4322-8953-92b305aedbe4","Type":"ContainerStarted","Data":"799b64eb7aa41d5e180be3a17f2e8701f96e694dc9703eeb7a7adb5507e5e99f"} Sep 16 08:58:30.331878 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.331844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f587ccd55-hnn7g" event={"ID":"9c50972c-d5d5-4c9d-ab45-e21beca0f51b","Type":"ContainerStarted","Data":"32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878"} Sep 16 08:58:30.333259 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.333227 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j6g7d" event={"ID":"eb92dc39-94de-4878-8934-3ba5387f3c55","Type":"ContainerStarted","Data":"e2810cf40ebcc612b953038f372242e0c7efb3c3648e8798ffc3e1b5b393ecec"} Sep 16 08:58:30.334363 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.334339 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t4hbk" event={"ID":"31a3ae67-af83-4267-bb9d-6d217a293b3a","Type":"ContainerStarted","Data":"43fe959d41223d48cbefa3d5afd7d873ac8d86994021ce53d2474568cb47aa5b"} Sep 16 08:58:30.348641 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.348593 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f587ccd55-hnn7g" podStartSLOduration=1.801050423 podStartE2EDuration="5.348578183s" totalImagesPullingTime="3.54752776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:30.347797269 +0000 UTC m=+66.935558865" watchObservedRunningTime="2026-09-16 08:58:30.348578183 +0000 UTC m=+66.936339777" Sep 16 08:58:30.807897 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.807802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.808333 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.807956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.809226 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.809122 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:30.817545 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:30.817516 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:31.071896 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.069691 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb"] Sep 16 08:58:31.076114 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.074855 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.079338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.078627 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 16 08:58:31.079338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.078674 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 16 08:58:31.079338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.078920 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 16 08:58:31.079338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.078975 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vz7gc\"" Sep 16 08:58:31.079338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.079176 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 16 08:58:31.079338 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.079346 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 16 08:58:31.081280 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.080104 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3qnevl9ctq4j2\"" Sep 16 08:58:31.088000 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.087607 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb"] Sep 16 08:58:31.097040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.096824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:58:31.110221 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.109721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.110221 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.109797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdz9\" (UniqueName: \"kubernetes.io/projected/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-kube-api-access-cxdz9\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.110221 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.109847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-metrics-client-ca\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.110221 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.109897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.110221 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.109927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.110221 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.109951 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-grpc-tls\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.110221 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.109985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.110221 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.110035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-tls\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.211411 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.211371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.211659 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.211459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdz9\" (UniqueName: \"kubernetes.io/projected/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-kube-api-access-cxdz9\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.211659 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.211509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-metrics-client-ca\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.211659 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.211550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.211659 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.211579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.211659 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.211604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-grpc-tls\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.211659 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.211639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.212063 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.211683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-tls\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.214084 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.214060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-metrics-client-ca\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.224881 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.224802 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-grpc-tls\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.226036 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.225974 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.226845 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.226806 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-tls\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.230983 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.230513 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.230983 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.230543 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.232334 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.232257 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.239277 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.239166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdz9\" (UniqueName: \"kubernetes.io/projected/451f5e4a-d90d-4ac1-ab0b-b7c7056146fe-kube-api-access-cxdz9\") pod \"thanos-querier-6d46dfc4df-kzwtb\" (UID: \"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe\") " pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:31.344747 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.344668 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" event={"ID":"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40","Type":"ContainerStarted","Data":"54484941bf63e16ccfce6cd89f9935dd69e7c65af508a3b46bd7e07aec8f4c5e"} Sep 16 08:58:31.344747 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.344740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" event={"ID":"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40","Type":"ContainerStarted","Data":"e346c21caf05ec6ced5818d7e16e5de411a0562238e9edf2419f8d7aae0da286"} Sep 16 08:58:31.392387 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:31.392100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:32.595526 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:32.594774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 08:58:32.667783 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:32.667649 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5265f55e_5f9a_4314_b74d_14d06458601c.slice/crio-9b938ab5eb4fd140fe61caa4637eb6fe89705110fda61d3899143089980934b5 WatchSource:0}: Error finding container 9b938ab5eb4fd140fe61caa4637eb6fe89705110fda61d3899143089980934b5: Status 404 returned error can't find the container with id 9b938ab5eb4fd140fe61caa4637eb6fe89705110fda61d3899143089980934b5 Sep 16 08:58:33.019375 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.019261 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb"] Sep 16 08:58:33.029476 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:33.029411 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451f5e4a_d90d_4ac1_ab0b_b7c7056146fe.slice/crio-e135a5218b65f5a5048bbb43c0f121fbb33865e24b0c549a17e019480a952e08 WatchSource:0}: Error finding container e135a5218b65f5a5048bbb43c0f121fbb33865e24b0c549a17e019480a952e08: Status 404 returned error can't find the container with id e135a5218b65f5a5048bbb43c0f121fbb33865e24b0c549a17e019480a952e08 Sep 16 08:58:33.359947 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.359903 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerStarted","Data":"9b938ab5eb4fd140fe61caa4637eb6fe89705110fda61d3899143089980934b5"} Sep 16 08:58:33.364841 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.364808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" event={"ID":"3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40","Type":"ContainerStarted","Data":"47149695b287bd787f7f5130177fddf7d7d2e3248bf66f53f7fbdbc157117c83"} Sep 16 08:58:33.372357 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.370291 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" event={"ID":"36b530db-d017-477d-bd7a-86a518bbc12a","Type":"ContainerStarted","Data":"8925ee8c7e68b3f0a901b8aa9edd179080ca795402dede448be0e630450dd981"} Sep 16 08:58:33.372357 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.370386 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" event={"ID":"36b530db-d017-477d-bd7a-86a518bbc12a","Type":"ContainerStarted","Data":"942dd9b9f1e7adadae05b8aebfbb25794444e96db8f3349902f5f7073325aa93"} Sep 16 08:58:33.372357 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.370416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" event={"ID":"36b530db-d017-477d-bd7a-86a518bbc12a","Type":"ContainerStarted","Data":"f6d5397591facc8442d046936c75c6e172b92fdfd83909a3a282a96b354ba00b"} Sep 16 08:58:33.375455 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.374662 2564 generic.go:356] "Generic (PLEG): container finished" podID="f069bb5c-c422-4ee8-8967-9d3d947a5cbb" containerID="56ef4b5f0412c9500221dbcb282aff91d8fbe54269359b85e6a8975772d417a8" exitCode=0 Sep 16 08:58:33.375455 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.374776 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64q69" event={"ID":"f069bb5c-c422-4ee8-8967-9d3d947a5cbb","Type":"ContainerDied","Data":"56ef4b5f0412c9500221dbcb282aff91d8fbe54269359b85e6a8975772d417a8"} Sep 16 08:58:33.378539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.378419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" event={"ID":"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe","Type":"ContainerStarted","Data":"e135a5218b65f5a5048bbb43c0f121fbb33865e24b0c549a17e019480a952e08"} Sep 16 08:58:33.382823 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.382294 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t4hbk" event={"ID":"31a3ae67-af83-4267-bb9d-6d217a293b3a","Type":"ContainerStarted","Data":"faa287d79a50fd506b2c85159a0c4c890de2c62a805cd39f312c00ee516e3de4"} Sep 16 08:58:33.382823 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.382340 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t4hbk" event={"ID":"31a3ae67-af83-4267-bb9d-6d217a293b3a","Type":"ContainerStarted","Data":"ae34266bd3ddd3eb8178254cb3e8d435c05a346dbf62fc6ff90705b59cc9e71f"} Sep 16 08:58:33.387589 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.386844 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-dwzbz" podStartSLOduration=2.123465291 podStartE2EDuration="4.386825648s" totalImagesPullingTime="2.263360357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:33.385574458 +0000 UTC m=+69.973336055" watchObservedRunningTime="2026-09-16 08:58:33.386825648 +0000 UTC m=+69.974587244" Sep 16 08:58:33.410596 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.409228 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-dd77fcd56-jnj4n"] Sep 16 08:58:33.414102 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.413993 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.419250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.418387 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dl8t6\"" Sep 16 08:58:33.419250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.418668 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 16 08:58:33.419250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.418838 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 16 08:58:33.419250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.418999 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 16 08:58:33.419250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.419089 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 16 08:58:33.419250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.419166 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4vhu88avu27i8\"" Sep 16 08:58:33.422914 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.422838 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dd77fcd56-jnj4n"] Sep 16 08:58:33.426562 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.426351 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t4hbk" podStartSLOduration=66.853162258 podStartE2EDuration="1m9.426334207s" totalImagesPullingTime="2.573171949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:33.426100036 +0000 UTC m=+70.013861633" watchObservedRunningTime="2026-09-16 08:58:33.426334207 +0000 UTC m=+70.014095796" Sep 16 08:58:33.442239 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.442204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/18a898d7-0aa6-436c-a1af-5ed6cc468460-secret-metrics-server-tls\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.442239 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.442249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/18a898d7-0aa6-436c-a1af-5ed6cc468460-audit-log\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.442452 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.442343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm68z\" (UniqueName: \"kubernetes.io/projected/18a898d7-0aa6-436c-a1af-5ed6cc468460-kube-api-access-zm68z\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.442515 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.442466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18a898d7-0aa6-436c-a1af-5ed6cc468460-client-ca-bundle\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.442677 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.442653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/18a898d7-0aa6-436c-a1af-5ed6cc468460-secret-metrics-server-client-certs\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.442803 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.442695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a898d7-0aa6-436c-a1af-5ed6cc468460-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.442803 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.442728 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/18a898d7-0aa6-436c-a1af-5ed6cc468460-metrics-server-audit-profiles\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.447241 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.447188 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-gnrmn" podStartSLOduration=1.892588571 podStartE2EDuration="4.447168283s" totalImagesPullingTime="2.554579712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:33.445457927 +0000 UTC m=+70.033219515" watchObservedRunningTime="2026-09-16 08:58:33.447168283 +0000 UTC m=+70.034929872" Sep 16 08:58:33.543362 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.543315 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/18a898d7-0aa6-436c-a1af-5ed6cc468460-secret-metrics-server-client-certs\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.543550 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.543375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a898d7-0aa6-436c-a1af-5ed6cc468460-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.543550 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.543406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/18a898d7-0aa6-436c-a1af-5ed6cc468460-metrics-server-audit-profiles\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.543550 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.543438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/18a898d7-0aa6-436c-a1af-5ed6cc468460-secret-metrics-server-tls\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.543550 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.543463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/18a898d7-0aa6-436c-a1af-5ed6cc468460-audit-log\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.543550 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.543501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm68z\" (UniqueName: \"kubernetes.io/projected/18a898d7-0aa6-436c-a1af-5ed6cc468460-kube-api-access-zm68z\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.543820 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.543555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18a898d7-0aa6-436c-a1af-5ed6cc468460-client-ca-bundle\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.544484 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.544456 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/18a898d7-0aa6-436c-a1af-5ed6cc468460-audit-log\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.544612 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.544457 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a898d7-0aa6-436c-a1af-5ed6cc468460-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.544970 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.544770 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/18a898d7-0aa6-436c-a1af-5ed6cc468460-metrics-server-audit-profiles\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.548143 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.547591 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/18a898d7-0aa6-436c-a1af-5ed6cc468460-secret-metrics-server-tls\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.548143 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.548103 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/18a898d7-0aa6-436c-a1af-5ed6cc468460-secret-metrics-server-client-certs\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.548648 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.548625 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18a898d7-0aa6-436c-a1af-5ed6cc468460-client-ca-bundle\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.554780 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.554734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm68z\" (UniqueName: \"kubernetes.io/projected/18a898d7-0aa6-436c-a1af-5ed6cc468460-kube-api-access-zm68z\") pod \"metrics-server-dd77fcd56-jnj4n\" (UID: \"18a898d7-0aa6-436c-a1af-5ed6cc468460\") " pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.730027 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.729995 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:33.868485 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.868452 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv"] Sep 16 08:58:33.872061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.872034 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:33.874583 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.874419 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 16 08:58:33.874583 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.874472 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mjtmf\"" Sep 16 08:58:33.882830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.882803 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv"] Sep 16 08:58:33.947200 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.947161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdfq4\" (UniqueName: \"kubernetes.io/projected/fe9017de-ea59-4fa9-ac36-f9c2a6507ffc-kube-api-access-jdfq4\") pod \"monitoring-plugin-5d85778b9d-4qcfv\" (UID: \"fe9017de-ea59-4fa9-ac36-f9c2a6507ffc\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:33.947369 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:33.947308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe9017de-ea59-4fa9-ac36-f9c2a6507ffc-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-4qcfv\" (UID: \"fe9017de-ea59-4fa9-ac36-f9c2a6507ffc\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:34.047965 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.047818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdfq4\" (UniqueName: \"kubernetes.io/projected/fe9017de-ea59-4fa9-ac36-f9c2a6507ffc-kube-api-access-jdfq4\") pod \"monitoring-plugin-5d85778b9d-4qcfv\" (UID: \"fe9017de-ea59-4fa9-ac36-f9c2a6507ffc\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:34.048122 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.047965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe9017de-ea59-4fa9-ac36-f9c2a6507ffc-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-4qcfv\" (UID: \"fe9017de-ea59-4fa9-ac36-f9c2a6507ffc\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:34.051077 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.051051 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe9017de-ea59-4fa9-ac36-f9c2a6507ffc-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-4qcfv\" (UID: \"fe9017de-ea59-4fa9-ac36-f9c2a6507ffc\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:34.052535 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.052508 2564 patch_prober.go:28] interesting pod/image-registry-68788df9d5-n8bpq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 16 08:58:34.052656 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.052558 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" podUID="03c6f49b-7f7b-4a6c-b524-8629f517d8b5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 16 08:58:34.056004 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.055981 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdfq4\" (UniqueName: \"kubernetes.io/projected/fe9017de-ea59-4fa9-ac36-f9c2a6507ffc-kube-api-access-jdfq4\") pod \"monitoring-plugin-5d85778b9d-4qcfv\" (UID: \"fe9017de-ea59-4fa9-ac36-f9c2a6507ffc\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:34.186624 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.186593 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:34.520136 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.520096 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67fdcb9cc8-pxvh4"] Sep 16 08:58:34.523500 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.523480 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.532933 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.532732 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 16 08:58:34.533823 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.533803 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67fdcb9cc8-pxvh4"] Sep 16 08:58:34.553708 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.553674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnpvw\" (UniqueName: \"kubernetes.io/projected/b292d055-40e9-461c-9984-dc50860728f2-kube-api-access-nnpvw\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.553877 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.553738 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-service-ca\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.553877 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.553771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-serving-cert\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.553877 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.553804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-oauth-serving-cert\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.553877 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.553832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-trusted-ca-bundle\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.554061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.553882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-console-config\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.554061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.553960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-oauth-config\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.654722 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.654686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnpvw\" (UniqueName: \"kubernetes.io/projected/b292d055-40e9-461c-9984-dc50860728f2-kube-api-access-nnpvw\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.654930 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.654743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-service-ca\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.654930 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.654773 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-serving-cert\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.654930 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.654803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-oauth-serving-cert\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.654930 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.654834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-trusted-ca-bundle\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.654930 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.654880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-console-config\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.654930 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.654920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-oauth-config\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.655548 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.655482 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-service-ca\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.655921 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.655853 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-trusted-ca-bundle\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.656037 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.655931 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-oauth-serving-cert\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.656446 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.656419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-console-config\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.657656 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.657636 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-serving-cert\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.657752 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.657702 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-oauth-config\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.662932 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.662908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnpvw\" (UniqueName: \"kubernetes.io/projected/b292d055-40e9-461c-9984-dc50860728f2-kube-api-access-nnpvw\") pod \"console-67fdcb9cc8-pxvh4\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:34.836013 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:34.835929 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:35.280781 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.280742 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 08:58:35.286753 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.286723 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.296369 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.296332 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 16 08:58:35.296648 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.296612 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 16 08:58:35.296748 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.296712 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 16 08:58:35.297489 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.297466 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 16 08:58:35.298147 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.297734 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ckk5t\"" Sep 16 08:58:35.298147 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.297749 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 16 08:58:35.298147 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.297785 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 16 08:58:35.298147 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.297686 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 16 08:58:35.298147 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.297887 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 16 08:58:35.298147 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.297646 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 16 08:58:35.298147 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.297952 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ae5pljif8u9l\"" Sep 16 08:58:35.298147 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.297696 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 16 08:58:35.299683 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.298815 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 16 08:58:35.302951 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.302245 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 16 08:58:35.303055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.302960 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 16 08:58:35.303055 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.302994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 08:58:35.307295 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.307274 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 16 08:58:35.362561 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.362561 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.362808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.362808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.362808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.362808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.362808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362735 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.362808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-config\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.362808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.362808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8g5\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-kube-api-access-gt8g5\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.362987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.363035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.363062 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.363085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.363112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.363250 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.363189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464140 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8g5\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-kube-api-access-gt8g5\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464343 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464433 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-config\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.464773 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.465320 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.464820 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.465500 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.465461 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.465612 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.465503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.466578 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.466224 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.466578 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.466566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.470201 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.467411 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.470201 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.467609 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.470201 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.467694 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.470855 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.470801 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.471521 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.471468 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.471521 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.471493 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.471696 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.471676 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.471761 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.471593 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.472438 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.472384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.472694 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.472664 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.473523 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.473503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.476067 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.476024 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8g5\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-kube-api-access-gt8g5\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.476405 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.476358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.476572 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.476554 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.477586 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.477563 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-config\") pod \"prometheus-k8s-0\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.606649 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.606299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:35.845982 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.845943 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:35.846429 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.846007 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:35.852561 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:35.852534 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:36.267190 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:36.267161 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68788df9d5-n8bpq" Sep 16 08:58:36.399786 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:36.399740 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:58:45.073384 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:45.073190 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv"] Sep 16 08:58:45.382399 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:45.381263 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9017de_ea59_4fa9_ac36_f9c2a6507ffc.slice/crio-9f31108d8f8376977b7f2400cf7ef3248e5da0ee2f7ad42d0d9c3a21eba7df62 WatchSource:0}: Error finding container 9f31108d8f8376977b7f2400cf7ef3248e5da0ee2f7ad42d0d9c3a21eba7df62: Status 404 returned error can't find the container with id 9f31108d8f8376977b7f2400cf7ef3248e5da0ee2f7ad42d0d9c3a21eba7df62 Sep 16 08:58:45.434706 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:45.434627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" event={"ID":"fe9017de-ea59-4fa9-ac36-f9c2a6507ffc","Type":"ContainerStarted","Data":"9f31108d8f8376977b7f2400cf7ef3248e5da0ee2f7ad42d0d9c3a21eba7df62"} Sep 16 08:58:45.669736 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:45.669648 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dd77fcd56-jnj4n"] Sep 16 08:58:45.670786 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:45.670753 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67fdcb9cc8-pxvh4"] Sep 16 08:58:45.678248 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:45.678229 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 08:58:45.702151 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:45.702117 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a898d7_0aa6_436c_a1af_5ed6cc468460.slice/crio-34a8a78f49942c1101edde1e5ba983cabafae828c17a00054f0f777562c41fd5 WatchSource:0}: Error finding container 34a8a78f49942c1101edde1e5ba983cabafae828c17a00054f0f777562c41fd5: Status 404 returned error can't find the container with id 34a8a78f49942c1101edde1e5ba983cabafae828c17a00054f0f777562c41fd5 Sep 16 08:58:45.703006 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:45.702950 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb292d055_40e9_461c_9984_dc50860728f2.slice/crio-e89b3a053e0326aa7a1c7aa11c9c662e2f13aa4cebed5deff64a56e02f2971f0 WatchSource:0}: Error finding container e89b3a053e0326aa7a1c7aa11c9c662e2f13aa4cebed5deff64a56e02f2971f0: Status 404 returned error can't find the container with id e89b3a053e0326aa7a1c7aa11c9c662e2f13aa4cebed5deff64a56e02f2971f0 Sep 16 08:58:45.704133 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:58:45.703998 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94999bd8_1793_49bc_a33a_96982799c5ff.slice/crio-9136ab13ebe4ac8798c565eb657a091e54b51c136696bf2c599254be350db38e WatchSource:0}: Error finding container 9136ab13ebe4ac8798c565eb657a091e54b51c136696bf2c599254be350db38e: Status 404 returned error can't find the container with id 9136ab13ebe4ac8798c565eb657a091e54b51c136696bf2c599254be350db38e Sep 16 08:58:46.453890 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.453749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64q69" event={"ID":"f069bb5c-c422-4ee8-8967-9d3d947a5cbb","Type":"ContainerStarted","Data":"df2dc88797d898d63ac760c60f6402c2ca119beca33500ff5814b7dc71d23d66"} Sep 16 08:58:46.453890 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.453815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-64q69" event={"ID":"f069bb5c-c422-4ee8-8967-9d3d947a5cbb","Type":"ContainerStarted","Data":"b3319b417af9298af0a00dd2838c2709a277356be40029399f5712730fd6dc1f"} Sep 16 08:58:46.459931 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.459078 2564 generic.go:356] "Generic (PLEG): container finished" podID="94999bd8-1793-49bc-a33a-96982799c5ff" containerID="c96eabf858d33e102ec93e8b480689b50f865ca5b4923a0721f81c8b349be5d1" exitCode=0 Sep 16 08:58:46.459931 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.459165 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerDied","Data":"c96eabf858d33e102ec93e8b480689b50f865ca5b4923a0721f81c8b349be5d1"} Sep 16 08:58:46.459931 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.459237 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerStarted","Data":"9136ab13ebe4ac8798c565eb657a091e54b51c136696bf2c599254be350db38e"} Sep 16 08:58:46.471113 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.470579 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67fdcb9cc8-pxvh4" event={"ID":"b292d055-40e9-461c-9984-dc50860728f2","Type":"ContainerStarted","Data":"69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8"} Sep 16 08:58:46.471113 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.470633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67fdcb9cc8-pxvh4" event={"ID":"b292d055-40e9-461c-9984-dc50860728f2","Type":"ContainerStarted","Data":"e89b3a053e0326aa7a1c7aa11c9c662e2f13aa4cebed5deff64a56e02f2971f0"} Sep 16 08:58:46.472899 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.472853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5pfmn" event={"ID":"cc8d5aba-2ac1-4322-8953-92b305aedbe4","Type":"ContainerStarted","Data":"43e3b8098115749a106e8275eaee3d66394718be3de9b2040be88116a3df0d34"} Sep 16 08:58:46.477911 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.477065 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-64q69" podStartSLOduration=14.732689331 podStartE2EDuration="17.477045684s" totalImagesPullingTime="2.608217536s" totalInitContainerRuntime="136.138817ms" isStatefulPod=true podCreationTimestamp="2026-09-16 08:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:46.474671041 +0000 UTC m=+83.062432635" watchObservedRunningTime="2026-09-16 08:58:46.477045684 +0000 UTC m=+83.064807279" Sep 16 08:58:46.479779 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.479345 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j6g7d" event={"ID":"eb92dc39-94de-4878-8934-3ba5387f3c55","Type":"ContainerStarted","Data":"9f203f2696ce756350a3e9f3c1cdfa13404f572c9b97ecc2bd87995855a61db5"} Sep 16 08:58:46.479779 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.479405 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:58:46.482598 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.482570 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtvjs" event={"ID":"8bf5749e-a5dd-4611-ad9e-f7f551f3b016","Type":"ContainerStarted","Data":"2bacc510371e19434fa9c3cd92f2d57ab95913f1ac529f5e681b31aa4894382a"} Sep 16 08:58:46.488213 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.488182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" event={"ID":"18a898d7-0aa6-436c-a1af-5ed6cc468460","Type":"ContainerStarted","Data":"34a8a78f49942c1101edde1e5ba983cabafae828c17a00054f0f777562c41fd5"} Sep 16 08:58:46.491078 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.491051 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" event={"ID":"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe","Type":"ContainerStarted","Data":"4d906f8f437259c6f05ed19cd73bf26ad15e9d347e15725105abd15ffb8272fa"} Sep 16 08:58:46.491262 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.491120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" event={"ID":"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe","Type":"ContainerStarted","Data":"7c3b69b4d6f80fc0a248c0645557a4ccaa54f944f9fef4e9e647b3e1d635deeb"} Sep 16 08:58:46.491262 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.491163 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" event={"ID":"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe","Type":"ContainerStarted","Data":"15e540dd06e84cee432a7eab5b48febf30381881533180b264845007518d26a9"} Sep 16 08:58:46.493373 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.492999 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67fdcb9cc8-pxvh4" podStartSLOduration=12.492982172 podStartE2EDuration="12.492982172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:46.49207496 +0000 UTC m=+83.079836562" watchObservedRunningTime="2026-09-16 08:58:46.492982172 +0000 UTC m=+83.080743767" Sep 16 08:58:46.499709 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.499328 2564 generic.go:356] "Generic (PLEG): container finished" podID="5265f55e-5f9a-4314-b74d-14d06458601c" containerID="f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf" exitCode=0 Sep 16 08:58:46.499709 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.499419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerDied","Data":"f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf"} Sep 16 08:58:46.508339 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.505785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-4c4b4" event={"ID":"05a40bab-9902-4913-8310-2d5ed4271fdd","Type":"ContainerStarted","Data":"4cd93c6ce4d093be38b444f8ce49270a9873bf900c9496d0c66548dbe222f2b2"} Sep 16 08:58:46.509096 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.508472 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-4c4b4" Sep 16 08:58:46.514240 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.514195 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-4c4b4" Sep 16 08:58:46.538031 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.536588 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5pfmn" podStartSLOduration=67.274208148 podStartE2EDuration="1m22.536567553s" totalImagesPullingTime="15.262359405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:46.535145181 +0000 UTC m=+83.122906775" watchObservedRunningTime="2026-09-16 08:58:46.536567553 +0000 UTC m=+83.124329147" Sep 16 08:58:46.556748 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.556342 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j6g7d" podStartSLOduration=67.317645295 podStartE2EDuration="1m22.556319801s" totalImagesPullingTime="15.238674506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:46.556182835 +0000 UTC m=+83.143944431" watchObservedRunningTime="2026-09-16 08:58:46.556319801 +0000 UTC m=+83.144081410" Sep 16 08:58:46.606149 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:46.604348 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-4c4b4" podStartSLOduration=2.82625363 podStartE2EDuration="25.604330855s" totalImagesPullingTime="22.778077225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:46.603545295 +0000 UTC m=+83.191306902" watchObservedRunningTime="2026-09-16 08:58:46.604330855 +0000 UTC m=+83.192092448" Sep 16 08:58:52.542731 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:52.542646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mtvjs" event={"ID":"8bf5749e-a5dd-4611-ad9e-f7f551f3b016","Type":"ContainerStarted","Data":"fdad2a2aa782d8a06d44fd1ea4223b6d4e9b1043645f346ba465feac652bec2b"} Sep 16 08:58:52.545822 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:52.545785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" event={"ID":"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe","Type":"ContainerStarted","Data":"dc8e8f68af9c755a74afda06e423d7a51632e3bdd0366938eefc47be8e507a80"} Sep 16 08:58:52.547755 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:52.547718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" event={"ID":"fe9017de-ea59-4fa9-ac36-f9c2a6507ffc","Type":"ContainerStarted","Data":"9afee30bcf538e4cddee8f8709c08db422d5a5b69d71b9dc6a093b2dd9f461c5"} Sep 16 08:58:52.547903 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:52.547778 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:52.554025 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:52.554006 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" Sep 16 08:58:52.561112 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:52.561065 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mtvjs" podStartSLOduration=9.777494661 podStartE2EDuration="31.561049559s" totalImagesPullingTime="21.783554898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 08:58:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:52.559634529 +0000 UTC m=+89.147396140" watchObservedRunningTime="2026-09-16 08:58:52.561049559 +0000 UTC m=+89.148811153" Sep 16 08:58:52.577920 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:52.577852 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-4qcfv" podStartSLOduration=12.741638516 podStartE2EDuration="19.577833508s" totalImagesPullingTime="6.836194992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:52.576058198 +0000 UTC m=+89.163819794" watchObservedRunningTime="2026-09-16 08:58:52.577833508 +0000 UTC m=+89.165595110" Sep 16 08:58:53.555898 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.555809 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" event={"ID":"18a898d7-0aa6-436c-a1af-5ed6cc468460","Type":"ContainerStarted","Data":"e7b38f35e64877f8381ac7074887d02eddde54edb07bca5b50431b9492f14205"} Sep 16 08:58:53.560311 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.560179 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" event={"ID":"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe","Type":"ContainerStarted","Data":"1a48be8b0b73098f04685ff6b5bc2e152104be6fcda58b11908f58ce78fc903b"} Sep 16 08:58:53.560311 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.560253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" event={"ID":"451f5e4a-d90d-4ac1-ab0b-b7c7056146fe","Type":"ContainerStarted","Data":"8cc76df82e1a5978259ab4d37b47442934df5a873e1e2ff886bc4d676ac8fb81"} Sep 16 08:58:53.560633 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.560568 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:53.565093 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.564535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerStarted","Data":"eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906"} Sep 16 08:58:53.565093 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.564588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerStarted","Data":"e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d"} Sep 16 08:58:53.565093 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.564618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerStarted","Data":"1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e"} Sep 16 08:58:53.565093 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.564641 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerStarted","Data":"dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b"} Sep 16 08:58:53.565093 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.564670 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerStarted","Data":"0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80"} Sep 16 08:58:53.565093 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.564700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerStarted","Data":"7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4"} Sep 16 08:58:53.567517 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.567497 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" Sep 16 08:58:53.569428 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.569392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerStarted","Data":"6f4d18f8f6713fbe74232cd46a829e03cc099e2b674ebaafc54e75d2cca06971"} Sep 16 08:58:53.569512 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.569467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerStarted","Data":"5f46d7543df7dfe8f2435ee6c149a8bbac40fdb2c7f9091a1ca40ff0372b4e77"} Sep 16 08:58:53.569512 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.569508 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerStarted","Data":"bcc27ce0cc8790add3a956e6c323ac807b1e73b771af0ed4ed509810fa9b359e"} Sep 16 08:58:53.569625 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.569549 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerStarted","Data":"261ce8401774b290ccc592d2656768e4fd2b439b44cac07a0d182ed401a135c3"} Sep 16 08:58:53.569625 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.569590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerStarted","Data":"ce7de092d3224f079ea1e6bc43fd68cd1dad2918598d816ab9f09cf52f3f4eed"} Sep 16 08:58:53.569723 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.569630 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerStarted","Data":"32bf3cd0bb3f4b55882893c4b949f564c8c68eb3b1fdfd1f56b10184dd07b862"} Sep 16 08:58:53.574695 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.574647 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" podStartSLOduration=14.062765066 podStartE2EDuration="20.574631306s" totalImagesPullingTime="6.51186624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:53.572652106 +0000 UTC m=+90.160413701" watchObservedRunningTime="2026-09-16 08:58:53.574631306 +0000 UTC m=+90.162392960" Sep 16 08:58:53.600022 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.599935 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.173479399 podStartE2EDuration="23.599917858s" totalImagesPullingTime="18.408428416s" totalInitContainerRuntime="18.010043ms" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:53.597389681 +0000 UTC m=+90.185151276" watchObservedRunningTime="2026-09-16 08:58:53.599917858 +0000 UTC m=+90.187679452" Sep 16 08:58:53.677642 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.677585 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d46dfc4df-kzwtb" podStartSLOduration=3.900907654 podStartE2EDuration="22.677565825s" totalImagesPullingTime="18.776658171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:53.675039526 +0000 UTC m=+90.262801131" watchObservedRunningTime="2026-09-16 08:58:53.677565825 +0000 UTC m=+90.265327420" Sep 16 08:58:53.677814 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.677755 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=12.463389377 podStartE2EDuration="18.677745843s" totalImagesPullingTime="6.157723165s" totalInitContainerRuntime="56.633301ms" isStatefulPod=false podCreationTimestamp="2026-09-16 08:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:58:53.631973639 +0000 UTC m=+90.219735232" watchObservedRunningTime="2026-09-16 08:58:53.677745843 +0000 UTC m=+90.265507437" Sep 16 08:58:53.730578 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.730543 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:53.730754 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:53.730641 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:58:54.836673 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:54.836635 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:54.837334 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:54.836780 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:54.841647 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:54.841625 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:55.584886 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:55.584846 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 08:58:55.607650 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:55.607620 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:58:55.629918 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:58:55.629885 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f587ccd55-hnn7g"] Sep 16 08:59:13.736406 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:13.736370 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:59:13.740124 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:13.740103 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-dd77fcd56-jnj4n" Sep 16 08:59:17.519576 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:17.519543 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j6g7d" Sep 16 08:59:20.649828 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:20.649767 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f587ccd55-hnn7g" podUID="9c50972c-d5d5-4c9d-ab45-e21beca0f51b" containerName="console" containerID="cri-o://32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878" gracePeriod=15 Sep 16 08:59:20.933005 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:20.932941 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:59:21.008270 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008233 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-config\") pod \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " Sep 16 08:59:21.008429 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008293 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-service-ca\") pod \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " Sep 16 08:59:21.008429 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008396 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-oauth-serving-cert\") pod \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " Sep 16 08:59:21.008522 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008462 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfxnk\" (UniqueName: \"kubernetes.io/projected/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-kube-api-access-wfxnk\") pod \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " Sep 16 08:59:21.008522 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008499 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-serving-cert\") pod \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " Sep 16 08:59:21.008605 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008529 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-oauth-config\") pod \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\" (UID: \"9c50972c-d5d5-4c9d-ab45-e21beca0f51b\") " Sep 16 08:59:21.008683 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008649 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-config" (OuterVolumeSpecName: "console-config") pod "9c50972c-d5d5-4c9d-ab45-e21beca0f51b" (UID: "9c50972c-d5d5-4c9d-ab45-e21beca0f51b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:21.008741 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008681 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-service-ca" (OuterVolumeSpecName: "service-ca") pod "9c50972c-d5d5-4c9d-ab45-e21beca0f51b" (UID: "9c50972c-d5d5-4c9d-ab45-e21beca0f51b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:21.008792 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008745 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9c50972c-d5d5-4c9d-ab45-e21beca0f51b" (UID: "9c50972c-d5d5-4c9d-ab45-e21beca0f51b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:21.008848 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008826 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-service-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:21.008848 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008841 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-oauth-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:21.008969 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.008855 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:21.010816 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.010783 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9c50972c-d5d5-4c9d-ab45-e21beca0f51b" (UID: "9c50972c-d5d5-4c9d-ab45-e21beca0f51b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:21.010925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.010815 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-kube-api-access-wfxnk" (OuterVolumeSpecName: "kube-api-access-wfxnk") pod "9c50972c-d5d5-4c9d-ab45-e21beca0f51b" (UID: "9c50972c-d5d5-4c9d-ab45-e21beca0f51b"). InnerVolumeSpecName "kube-api-access-wfxnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 08:59:21.010925 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.010834 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9c50972c-d5d5-4c9d-ab45-e21beca0f51b" (UID: "9c50972c-d5d5-4c9d-ab45-e21beca0f51b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:21.109938 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.109907 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfxnk\" (UniqueName: \"kubernetes.io/projected/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-kube-api-access-wfxnk\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:21.109938 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.109932 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:21.109938 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.109941 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c50972c-d5d5-4c9d-ab45-e21beca0f51b-console-oauth-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:21.699319 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.699283 2564 generic.go:356] "Generic (PLEG): container finished" podID="9c50972c-d5d5-4c9d-ab45-e21beca0f51b" containerID="32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878" exitCode=0 Sep 16 08:59:21.699703 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.699327 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f587ccd55-hnn7g" Sep 16 08:59:21.699703 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.699370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f587ccd55-hnn7g" event={"ID":"9c50972c-d5d5-4c9d-ab45-e21beca0f51b","Type":"ContainerDied","Data":"32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878"} Sep 16 08:59:21.699703 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.699426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f587ccd55-hnn7g" event={"ID":"9c50972c-d5d5-4c9d-ab45-e21beca0f51b","Type":"ContainerDied","Data":"6d99a12a6f1646371cd414a325e78d18104d72362d5f819f3540f98b63f3019b"} Sep 16 08:59:21.699703 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.699447 2564 scope.go:117] "RemoveContainer" containerID="32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878" Sep 16 08:59:21.715920 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.715898 2564 scope.go:117] "RemoveContainer" containerID="32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878" Sep 16 08:59:21.716236 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:59:21.716213 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878\": container with ID starting with 32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878 not found: ID does not exist" containerID="32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878" Sep 16 08:59:21.716325 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.716241 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878"} err="failed to get container status \"32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878\": rpc error: code = NotFound desc = could not find container \"32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878\": container with ID starting with 32cb2c9ba9a236526da7d6d9c6f2bf52bb8d181d27917bf3b22ad20634b86878 not found: ID does not exist" Sep 16 08:59:21.719630 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.719611 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f587ccd55-hnn7g"] Sep 16 08:59:21.723072 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.723050 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f587ccd55-hnn7g"] Sep 16 08:59:21.916523 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:21.916490 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c50972c-d5d5-4c9d-ab45-e21beca0f51b" path="/var/lib/kubelet/pods/9c50972c-d5d5-4c9d-ab45-e21beca0f51b/volumes" Sep 16 08:59:35.607445 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:35.607409 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:35.672619 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:35.672592 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:35.771056 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:35.771027 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:49.348840 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.348799 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 08:59:49.349462 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.349170 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="alertmanager" containerID="cri-o://7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4" gracePeriod=120 Sep 16 08:59:49.349462 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.349253 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy-metric" containerID="cri-o://e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d" gracePeriod=120 Sep 16 08:59:49.349462 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.349266 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy-web" containerID="cri-o://dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b" gracePeriod=120 Sep 16 08:59:49.349462 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.349276 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="config-reloader" containerID="cri-o://0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80" gracePeriod=120 Sep 16 08:59:49.349462 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.349356 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy" containerID="cri-o://1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e" gracePeriod=120 Sep 16 08:59:49.349462 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.349342 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="prom-label-proxy" containerID="cri-o://eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906" gracePeriod=120 Sep 16 08:59:49.816219 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816185 2564 generic.go:356] "Generic (PLEG): container finished" podID="5265f55e-5f9a-4314-b74d-14d06458601c" containerID="eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906" exitCode=0 Sep 16 08:59:49.816219 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816213 2564 generic.go:356] "Generic (PLEG): container finished" podID="5265f55e-5f9a-4314-b74d-14d06458601c" containerID="e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d" exitCode=0 Sep 16 08:59:49.816219 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816219 2564 generic.go:356] "Generic (PLEG): container finished" podID="5265f55e-5f9a-4314-b74d-14d06458601c" containerID="1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e" exitCode=0 Sep 16 08:59:49.816219 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816227 2564 generic.go:356] "Generic (PLEG): container finished" podID="5265f55e-5f9a-4314-b74d-14d06458601c" containerID="0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80" exitCode=0 Sep 16 08:59:49.816468 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816232 2564 generic.go:356] "Generic (PLEG): container finished" podID="5265f55e-5f9a-4314-b74d-14d06458601c" containerID="7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4" exitCode=0 Sep 16 08:59:49.816468 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816254 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerDied","Data":"eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906"} Sep 16 08:59:49.816468 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerDied","Data":"e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d"} Sep 16 08:59:49.816468 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerDied","Data":"1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e"} Sep 16 08:59:49.816468 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerDied","Data":"0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80"} Sep 16 08:59:49.816468 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:49.816392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerDied","Data":"7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4"} Sep 16 08:59:50.589262 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.589238 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.665561 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665479 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-main-tls\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.665561 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665524 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-main-db\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.665561 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665560 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-metrics-client-ca\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.665808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665739 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-cluster-tls-config\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.665808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665786 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-config-volume\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.665932 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665814 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 08:59:50.665932 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665827 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.665932 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665909 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-config-out\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.666085 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665942 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwxkp\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-kube-api-access-cwxkp\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.666085 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665986 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-tls-assets\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.666085 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.666017 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.666085 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.666056 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-web\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.666297 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.666108 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-trusted-ca-bundle\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.666297 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.666145 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-web-config\") pod \"5265f55e-5f9a-4314-b74d-14d06458601c\" (UID: \"5265f55e-5f9a-4314-b74d-14d06458601c\") " Sep 16 08:59:50.666453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.666431 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-main-db\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.666836 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.665908 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:50.667207 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.667179 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:50.668816 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.668786 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:50.670251 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.670215 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-kube-api-access-cwxkp" (OuterVolumeSpecName: "kube-api-access-cwxkp") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "kube-api-access-cwxkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 08:59:50.670453 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.670390 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-config-volume" (OuterVolumeSpecName: "config-volume") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:50.670820 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.670773 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:50.670820 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.670778 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-config-out" (OuterVolumeSpecName: "config-out") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 08:59:50.671040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.671009 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:50.671174 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.671153 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 08:59:50.671512 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.671479 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:50.674003 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.673980 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:50.682434 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.682413 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-web-config" (OuterVolumeSpecName: "web-config") pod "5265f55e-5f9a-4314-b74d-14d06458601c" (UID: "5265f55e-5f9a-4314-b74d-14d06458601c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:50.767371 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767344 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767371 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767369 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767380 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767390 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-web-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767398 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-main-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767408 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5265f55e-5f9a-4314-b74d-14d06458601c-metrics-client-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767416 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-cluster-tls-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767426 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-config-volume\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767434 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5265f55e-5f9a-4314-b74d-14d06458601c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767443 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5265f55e-5f9a-4314-b74d-14d06458601c-config-out\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767451 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwxkp\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-kube-api-access-cwxkp\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.767539 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.767458 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5265f55e-5f9a-4314-b74d-14d06458601c-tls-assets\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:50.824265 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.824235 2564 generic.go:356] "Generic (PLEG): container finished" podID="5265f55e-5f9a-4314-b74d-14d06458601c" containerID="dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b" exitCode=0 Sep 16 08:59:50.824435 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.824283 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerDied","Data":"dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b"} Sep 16 08:59:50.824435 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.824329 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.824435 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.824347 2564 scope.go:117] "RemoveContainer" containerID="eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906" Sep 16 08:59:50.824597 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.824337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5265f55e-5f9a-4314-b74d-14d06458601c","Type":"ContainerDied","Data":"9b938ab5eb4fd140fe61caa4637eb6fe89705110fda61d3899143089980934b5"} Sep 16 08:59:50.832536 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.832481 2564 scope.go:117] "RemoveContainer" containerID="e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d" Sep 16 08:59:50.839401 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.839383 2564 scope.go:117] "RemoveContainer" containerID="1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e" Sep 16 08:59:50.846340 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.846321 2564 scope.go:117] "RemoveContainer" containerID="dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b" Sep 16 08:59:50.853709 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.853692 2564 scope.go:117] "RemoveContainer" containerID="0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80" Sep 16 08:59:50.855070 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.855046 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 08:59:50.861166 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.861146 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 08:59:50.861958 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.861943 2564 scope.go:117] "RemoveContainer" containerID="7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4" Sep 16 08:59:50.869013 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.868994 2564 scope.go:117] "RemoveContainer" containerID="f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf" Sep 16 08:59:50.875753 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.875735 2564 scope.go:117] "RemoveContainer" containerID="eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906" Sep 16 08:59:50.876046 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:59:50.876027 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906\": container with ID starting with eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906 not found: ID does not exist" containerID="eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906" Sep 16 08:59:50.876099 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.876060 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906"} err="failed to get container status \"eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906\": rpc error: code = NotFound desc = could not find container \"eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906\": container with ID starting with eb575808ff4a2b2e8a877965c0666a308f78d64a7d9233205b2c240c80e9e906 not found: ID does not exist" Sep 16 08:59:50.876099 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.876079 2564 scope.go:117] "RemoveContainer" containerID="e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d" Sep 16 08:59:50.876346 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:59:50.876329 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d\": container with ID starting with e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d not found: ID does not exist" containerID="e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d" Sep 16 08:59:50.876386 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.876352 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d"} err="failed to get container status \"e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d\": rpc error: code = NotFound desc = could not find container \"e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d\": container with ID starting with e70137a35bac745cab5435fb0ac8a14cc88ac2f6c2784511ecb2e5da41adea1d not found: ID does not exist" Sep 16 08:59:50.876386 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.876369 2564 scope.go:117] "RemoveContainer" containerID="1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e" Sep 16 08:59:50.876607 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:59:50.876588 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e\": container with ID starting with 1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e not found: ID does not exist" containerID="1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e" Sep 16 08:59:50.876645 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.876611 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e"} err="failed to get container status \"1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e\": rpc error: code = NotFound desc = could not find container \"1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e\": container with ID starting with 1d1c8729b53bbef419f364c5270f5b70e4868177572945138bee6f1393a1b19e not found: ID does not exist" Sep 16 08:59:50.876645 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.876627 2564 scope.go:117] "RemoveContainer" containerID="dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b" Sep 16 08:59:50.876896 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:59:50.876876 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b\": container with ID starting with dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b not found: ID does not exist" containerID="dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b" Sep 16 08:59:50.876956 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.876899 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b"} err="failed to get container status \"dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b\": rpc error: code = NotFound desc = could not find container \"dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b\": container with ID starting with dda30d5f93c5cbab0360ee6291e3a8d17a3320d38e728c1423f94adcc196364b not found: ID does not exist" Sep 16 08:59:50.876956 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.876912 2564 scope.go:117] "RemoveContainer" containerID="0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80" Sep 16 08:59:50.877161 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:59:50.877143 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80\": container with ID starting with 0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80 not found: ID does not exist" containerID="0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80" Sep 16 08:59:50.877205 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.877163 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80"} err="failed to get container status \"0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80\": rpc error: code = NotFound desc = could not find container \"0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80\": container with ID starting with 0c2f2ac94f08a1e3f37746bdfb3fcc071506ff855ee407084b908a4b4dd3db80 not found: ID does not exist" Sep 16 08:59:50.877205 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.877176 2564 scope.go:117] "RemoveContainer" containerID="7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4" Sep 16 08:59:50.877414 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:59:50.877398 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4\": container with ID starting with 7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4 not found: ID does not exist" containerID="7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4" Sep 16 08:59:50.877456 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.877418 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4"} err="failed to get container status \"7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4\": rpc error: code = NotFound desc = could not find container \"7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4\": container with ID starting with 7c32e629cdbcf3f8d5090a194f874240b9ba39f9b6099eab2c31dd7a561eb1b4 not found: ID does not exist" Sep 16 08:59:50.877456 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.877433 2564 scope.go:117] "RemoveContainer" containerID="f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf" Sep 16 08:59:50.877649 ip-10-0-141-124 kubenswrapper[2564]: E0916 08:59:50.877632 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf\": container with ID starting with f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf not found: ID does not exist" containerID="f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf" Sep 16 08:59:50.877696 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.877653 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf"} err="failed to get container status \"f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf\": rpc error: code = NotFound desc = could not find container \"f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf\": container with ID starting with f248e81d78b522105325928f0686c5e227c7c0433ca4669bc2edf5f16bf2b2bf not found: ID does not exist" Sep 16 08:59:50.906314 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906284 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 08:59:50.906601 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906588 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy-web" Sep 16 08:59:50.906648 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906602 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy-web" Sep 16 08:59:50.906648 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906614 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="alertmanager" Sep 16 08:59:50.906648 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906621 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="alertmanager" Sep 16 08:59:50.906648 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906627 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c50972c-d5d5-4c9d-ab45-e21beca0f51b" containerName="console" Sep 16 08:59:50.906648 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906633 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c50972c-d5d5-4c9d-ab45-e21beca0f51b" containerName="console" Sep 16 08:59:50.906648 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906640 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy" Sep 16 08:59:50.906648 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906647 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906654 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="config-reloader" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906659 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="config-reloader" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906668 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="init-config-reloader" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906673 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="init-config-reloader" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906681 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="prom-label-proxy" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906686 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="prom-label-proxy" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906701 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy-metric" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906706 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy-metric" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906755 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c50972c-d5d5-4c9d-ab45-e21beca0f51b" containerName="console" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906763 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy-web" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906768 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906773 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="prom-label-proxy" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906779 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="kube-rbac-proxy-metric" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906785 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="config-reloader" Sep 16 08:59:50.906847 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.906793 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" containerName="alertmanager" Sep 16 08:59:50.910481 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.910460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.913127 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.913101 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 16 08:59:50.913327 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.913306 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 16 08:59:50.913419 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.913380 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 16 08:59:50.913419 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.913390 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 16 08:59:50.913419 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.913400 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 16 08:59:50.913582 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.913446 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 16 08:59:50.913582 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.913469 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 16 08:59:50.913667 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.913653 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 16 08:59:50.913882 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.913844 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-knt8g\"" Sep 16 08:59:50.919492 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.919473 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 16 08:59:50.926544 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.926522 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 08:59:50.968821 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.968793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d6540db-3836-4b6a-93b0-662fdf423aa3-config-out\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969003 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.968830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969003 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.968849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d6540db-3836-4b6a-93b0-662fdf423aa3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969003 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.968947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969003 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.968986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d6540db-3836-4b6a-93b0-662fdf423aa3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969150 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.969006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d6540db-3836-4b6a-93b0-662fdf423aa3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969150 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.969029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969150 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.969078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs7gk\" (UniqueName: \"kubernetes.io/projected/0d6540db-3836-4b6a-93b0-662fdf423aa3-kube-api-access-hs7gk\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969150 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.969119 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6540db-3836-4b6a-93b0-662fdf423aa3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969150 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.969142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969320 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.969157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969320 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.969207 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:50.969320 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:50.969225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-web-config\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070030 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.069994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070030 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070259 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070259 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-web-config\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070259 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d6540db-3836-4b6a-93b0-662fdf423aa3-config-out\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070407 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070407 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d6540db-3836-4b6a-93b0-662fdf423aa3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070407 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070407 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d6540db-3836-4b6a-93b0-662fdf423aa3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070608 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d6540db-3836-4b6a-93b0-662fdf423aa3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070608 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070608 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs7gk\" (UniqueName: \"kubernetes.io/projected/0d6540db-3836-4b6a-93b0-662fdf423aa3-kube-api-access-hs7gk\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.070608 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.070550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6540db-3836-4b6a-93b0-662fdf423aa3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.071488 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.071437 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d6540db-3836-4b6a-93b0-662fdf423aa3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.071488 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.071478 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6540db-3836-4b6a-93b0-662fdf423aa3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.071850 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.071803 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d6540db-3836-4b6a-93b0-662fdf423aa3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.073398 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.073153 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.073398 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.073288 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.073398 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.073334 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d6540db-3836-4b6a-93b0-662fdf423aa3-config-out\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.073398 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.073358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-web-config\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.073398 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.073387 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.073831 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.073812 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.074067 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.074050 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d6540db-3836-4b6a-93b0-662fdf423aa3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.074587 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.074567 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.074729 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.074711 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d6540db-3836-4b6a-93b0-662fdf423aa3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.079322 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.079301 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs7gk\" (UniqueName: \"kubernetes.io/projected/0d6540db-3836-4b6a-93b0-662fdf423aa3-kube-api-access-hs7gk\") pod \"alertmanager-main-0\" (UID: \"0d6540db-3836-4b6a-93b0-662fdf423aa3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.220302 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.220215 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 16 08:59:51.508098 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.508066 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 16 08:59:51.830332 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.830239 2564 generic.go:356] "Generic (PLEG): container finished" podID="0d6540db-3836-4b6a-93b0-662fdf423aa3" containerID="72257c5b4f83635800ad671bdb096771400dc2edd868c2d8fd25261e8da698be" exitCode=0 Sep 16 08:59:51.830332 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.830301 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6540db-3836-4b6a-93b0-662fdf423aa3","Type":"ContainerDied","Data":"72257c5b4f83635800ad671bdb096771400dc2edd868c2d8fd25261e8da698be"} Sep 16 08:59:51.830830 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.830374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6540db-3836-4b6a-93b0-662fdf423aa3","Type":"ContainerStarted","Data":"e7947f30aa57b8fdb0a685e681aabe4875e0764735ae6bf3736acb498bba7c6d"} Sep 16 08:59:51.915947 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:51.915912 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5265f55e-5f9a-4314-b74d-14d06458601c" path="/var/lib/kubelet/pods/5265f55e-5f9a-4314-b74d-14d06458601c/volumes" Sep 16 08:59:52.837563 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:52.837532 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6540db-3836-4b6a-93b0-662fdf423aa3","Type":"ContainerStarted","Data":"4c380a5928f70490a555709b28403d4f4e5a1e5ebf1d6125ffdabfc3ba1b641c"} Sep 16 08:59:52.837949 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:52.837596 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6540db-3836-4b6a-93b0-662fdf423aa3","Type":"ContainerStarted","Data":"97496492377c347c8edb4f0ce888d312663f968cf82c13942379d5556609cef5"} Sep 16 08:59:52.837949 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:52.837621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6540db-3836-4b6a-93b0-662fdf423aa3","Type":"ContainerStarted","Data":"28f5d4f3808b66cc38b2237a49987528a7e600f28a7f2478fe96fb3745a7f2e0"} Sep 16 08:59:52.837949 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:52.837646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6540db-3836-4b6a-93b0-662fdf423aa3","Type":"ContainerStarted","Data":"6e87e787b535518cc2f4d9207bc4320ef6f3f9d2941ee5a122c971569c783b2e"} Sep 16 08:59:52.837949 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:52.837671 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6540db-3836-4b6a-93b0-662fdf423aa3","Type":"ContainerStarted","Data":"731fbc8a27a703b54dfb28b900468946434530d008868308330e29cbd6b44903"} Sep 16 08:59:52.837949 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:52.837694 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d6540db-3836-4b6a-93b0-662fdf423aa3","Type":"ContainerStarted","Data":"ac18b564d91d355ec5ceb513ef4f95c27f0615f4ca85d3d242512dc31efe4b64"} Sep 16 08:59:52.871855 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:52.871793 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.855887828 podStartE2EDuration="2.871772804s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.884976ms" isStatefulPod=false podCreationTimestamp="2026-09-16 08:59:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:59:52.869470253 +0000 UTC m=+149.457231847" watchObservedRunningTime="2026-09-16 08:59:52.871772804 +0000 UTC m=+149.459534400" Sep 16 08:59:53.661040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.661008 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 08:59:53.661335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.661296 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="prometheus" containerID="cri-o://32bf3cd0bb3f4b55882893c4b949f564c8c68eb3b1fdfd1f56b10184dd07b862" gracePeriod=600 Sep 16 08:59:53.661335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.661316 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy" containerID="cri-o://5f46d7543df7dfe8f2435ee6c149a8bbac40fdb2c7f9091a1ca40ff0372b4e77" gracePeriod=600 Sep 16 08:59:53.661576 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.661342 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6f4d18f8f6713fbe74232cd46a829e03cc099e2b674ebaafc54e75d2cca06971" gracePeriod=600 Sep 16 08:59:53.661576 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.661362 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="config-reloader" containerID="cri-o://ce7de092d3224f079ea1e6bc43fd68cd1dad2918598d816ab9f09cf52f3f4eed" gracePeriod=600 Sep 16 08:59:53.661576 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.661367 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy-web" containerID="cri-o://bcc27ce0cc8790add3a956e6c323ac807b1e73b771af0ed4ed509810fa9b359e" gracePeriod=600 Sep 16 08:59:53.661576 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.661525 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="thanos-sidecar" containerID="cri-o://261ce8401774b290ccc592d2656768e4fd2b439b44cac07a0d182ed401a135c3" gracePeriod=600 Sep 16 08:59:53.858061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858024 2564 generic.go:356] "Generic (PLEG): container finished" podID="94999bd8-1793-49bc-a33a-96982799c5ff" containerID="6f4d18f8f6713fbe74232cd46a829e03cc099e2b674ebaafc54e75d2cca06971" exitCode=0 Sep 16 08:59:53.858061 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858055 2564 generic.go:356] "Generic (PLEG): container finished" podID="94999bd8-1793-49bc-a33a-96982799c5ff" containerID="5f46d7543df7dfe8f2435ee6c149a8bbac40fdb2c7f9091a1ca40ff0372b4e77" exitCode=0 Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858069 2564 generic.go:356] "Generic (PLEG): container finished" podID="94999bd8-1793-49bc-a33a-96982799c5ff" containerID="bcc27ce0cc8790add3a956e6c323ac807b1e73b771af0ed4ed509810fa9b359e" exitCode=0 Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerDied","Data":"6f4d18f8f6713fbe74232cd46a829e03cc099e2b674ebaafc54e75d2cca06971"} Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858158 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerDied","Data":"5f46d7543df7dfe8f2435ee6c149a8bbac40fdb2c7f9091a1ca40ff0372b4e77"} Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858081 2564 generic.go:356] "Generic (PLEG): container finished" podID="94999bd8-1793-49bc-a33a-96982799c5ff" containerID="261ce8401774b290ccc592d2656768e4fd2b439b44cac07a0d182ed401a135c3" exitCode=0 Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerDied","Data":"bcc27ce0cc8790add3a956e6c323ac807b1e73b771af0ed4ed509810fa9b359e"} Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858240 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerDied","Data":"261ce8401774b290ccc592d2656768e4fd2b439b44cac07a0d182ed401a135c3"} Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858195 2564 generic.go:356] "Generic (PLEG): container finished" podID="94999bd8-1793-49bc-a33a-96982799c5ff" containerID="ce7de092d3224f079ea1e6bc43fd68cd1dad2918598d816ab9f09cf52f3f4eed" exitCode=0 Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858277 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerDied","Data":"ce7de092d3224f079ea1e6bc43fd68cd1dad2918598d816ab9f09cf52f3f4eed"} Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858285 2564 generic.go:356] "Generic (PLEG): container finished" podID="94999bd8-1793-49bc-a33a-96982799c5ff" containerID="32bf3cd0bb3f4b55882893c4b949f564c8c68eb3b1fdfd1f56b10184dd07b862" exitCode=0 Sep 16 08:59:53.858555 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.858318 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerDied","Data":"32bf3cd0bb3f4b55882893c4b949f564c8c68eb3b1fdfd1f56b10184dd07b862"} Sep 16 08:59:53.906316 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.906286 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:53.998808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.998719 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.998808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.998767 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-db\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.998808 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.998800 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999088 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.998923 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-metrics-client-ca\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999088 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.998961 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-grpc-tls\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999088 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.998988 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-config\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999088 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999022 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-serving-certs-ca-bundle\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999088 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999050 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-web-config\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999089 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-metrics-client-certs\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999125 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-0\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999151 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-trusted-ca-bundle\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999182 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-tls\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999211 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-kubelet-serving-ca-bundle\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999239 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-1\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999263 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-2\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999285 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:53.999335 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999302 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-tls-assets\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999781 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999367 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-kube-rbac-proxy\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999781 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999409 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-config-out\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999781 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999443 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt8g5\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-kube-api-access-gt8g5\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:53.999781 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999491 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-thanos-prometheus-http-client-file\") pod \"94999bd8-1793-49bc-a33a-96982799c5ff\" (UID: \"94999bd8-1793-49bc-a33a-96982799c5ff\") " Sep 16 08:59:54.000009 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:53.999812 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-metrics-client-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.000064 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.000047 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 08:59:54.000570 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.000538 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:54.001376 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.001346 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:54.001477 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.001458 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:54.001688 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.001663 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:54.003018 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.002971 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:54.003282 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.003259 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 08:59:54.003669 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.003648 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 08:59:54.003778 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.003728 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:54.003911 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.003851 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:54.004153 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.004125 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:54.004259 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.004210 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:54.004323 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.004262 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-config-out" (OuterVolumeSpecName: "config-out") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 08:59:54.004323 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.004293 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:54.004398 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.004359 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-config" (OuterVolumeSpecName: "config") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:54.004491 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.004462 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:54.004857 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.004833 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:54.005119 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.005100 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-kube-api-access-gt8g5" (OuterVolumeSpecName: "kube-api-access-gt8g5") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "kube-api-access-gt8g5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 08:59:54.015849 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.015823 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-web-config" (OuterVolumeSpecName: "web-config") pod "94999bd8-1793-49bc-a33a-96982799c5ff" (UID: "94999bd8-1793-49bc-a33a-96982799c5ff"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 08:59:54.100746 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100716 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-grpc-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100746 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100740 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100746 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100751 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100759 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-web-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100771 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-metrics-client-certs\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100780 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100789 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100797 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100805 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100813 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100822 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100830 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-tls-assets\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100838 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-kube-rbac-proxy\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100845 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-config-out\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100853 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt8g5\" (UniqueName: \"kubernetes.io/projected/94999bd8-1793-49bc-a33a-96982799c5ff-kube-api-access-gt8g5\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100880 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100889 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100897 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/94999bd8-1793-49bc-a33a-96982799c5ff-prometheus-k8s-db\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.100962 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.100905 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94999bd8-1793-49bc-a33a-96982799c5ff-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 08:59:54.866312 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.866278 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"94999bd8-1793-49bc-a33a-96982799c5ff","Type":"ContainerDied","Data":"9136ab13ebe4ac8798c565eb657a091e54b51c136696bf2c599254be350db38e"} Sep 16 08:59:54.866312 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.866314 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:54.866768 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.866350 2564 scope.go:117] "RemoveContainer" containerID="6f4d18f8f6713fbe74232cd46a829e03cc099e2b674ebaafc54e75d2cca06971" Sep 16 08:59:54.875174 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.875067 2564 scope.go:117] "RemoveContainer" containerID="5f46d7543df7dfe8f2435ee6c149a8bbac40fdb2c7f9091a1ca40ff0372b4e77" Sep 16 08:59:54.882895 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.882836 2564 scope.go:117] "RemoveContainer" containerID="bcc27ce0cc8790add3a956e6c323ac807b1e73b771af0ed4ed509810fa9b359e" Sep 16 08:59:54.889823 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.889801 2564 scope.go:117] "RemoveContainer" containerID="261ce8401774b290ccc592d2656768e4fd2b439b44cac07a0d182ed401a135c3" Sep 16 08:59:54.891603 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.891583 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 08:59:54.895187 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.895166 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 08:59:54.897483 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.897463 2564 scope.go:117] "RemoveContainer" containerID="ce7de092d3224f079ea1e6bc43fd68cd1dad2918598d816ab9f09cf52f3f4eed" Sep 16 08:59:54.904028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.904013 2564 scope.go:117] "RemoveContainer" containerID="32bf3cd0bb3f4b55882893c4b949f564c8c68eb3b1fdfd1f56b10184dd07b862" Sep 16 08:59:54.910794 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.910781 2564 scope.go:117] "RemoveContainer" containerID="c96eabf858d33e102ec93e8b480689b50f865ca5b4923a0721f81c8b349be5d1" Sep 16 08:59:54.922656 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.922632 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 08:59:54.922963 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.922951 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="config-reloader" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.922965 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="config-reloader" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.922976 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="thanos-sidecar" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.922982 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="thanos-sidecar" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.922992 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy-thanos" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.922997 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy-thanos" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923006 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="prometheus" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923011 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="prometheus" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923017 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy-web" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923023 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy-web" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923034 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923039 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy" Sep 16 08:59:54.923040 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923046 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="init-config-reloader" Sep 16 08:59:54.923604 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923051 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="init-config-reloader" Sep 16 08:59:54.923604 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923110 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="prometheus" Sep 16 08:59:54.923604 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923121 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="thanos-sidecar" Sep 16 08:59:54.923604 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923129 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy-thanos" Sep 16 08:59:54.923604 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923139 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="config-reloader" Sep 16 08:59:54.923604 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923150 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy" Sep 16 08:59:54.923604 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.923160 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" containerName="kube-rbac-proxy-web" Sep 16 08:59:54.927083 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.927061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:54.931041 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.929992 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 16 08:59:54.931041 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.930208 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 16 08:59:54.931041 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.930370 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 16 08:59:54.931041 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.930541 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ckk5t\"" Sep 16 08:59:54.931041 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.930887 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 16 08:59:54.931337 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.931112 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 16 08:59:54.931337 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.931150 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 16 08:59:54.931337 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.931161 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 16 08:59:54.931337 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.931216 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ae5pljif8u9l\"" Sep 16 08:59:54.931337 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.931306 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 16 08:59:54.931608 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.931360 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 16 08:59:54.931670 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.931614 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 16 08:59:54.931670 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.931629 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 16 08:59:54.931884 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.931846 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 16 08:59:54.934469 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.934441 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 16 08:59:54.940449 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.940423 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 16 08:59:54.948318 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:54.948293 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 08:59:55.007364 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007364 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007390 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007565 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007758 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007758 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007758 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007758 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs5qk\" (UniqueName: \"kubernetes.io/projected/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-kube-api-access-qs5qk\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007758 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007758 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.007758 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.008005 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.008005 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.008005 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.008005 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.008005 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.007851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.108720 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.108688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.108720 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.108728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.108980 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.108752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.108980 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.108770 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.108980 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.108784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.108980 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.108916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs5qk\" (UniqueName: \"kubernetes.io/projected/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-kube-api-access-qs5qk\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109177 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.108968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109177 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109406 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109486 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109486 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109594 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109594 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109594 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109594 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109588 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109779 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109779 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109630 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109779 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109779 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.109779 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.110058 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.110058 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.109797 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.110301 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.110279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.110378 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.110352 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.111028 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.111000 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.111992 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.111967 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.112103 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.112005 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.112103 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.112045 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.112752 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.112725 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.113017 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.112992 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.113099 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.113047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.113448 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.113422 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.113582 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.113558 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.113651 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.113638 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.113998 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.113970 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.114608 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.114579 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.114760 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.114741 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.115318 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.115301 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.115536 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.115514 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.117431 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.117409 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs5qk\" (UniqueName: \"kubernetes.io/projected/d0ec9455-ea82-4a0f-abb2-fd1d1af156ea-kube-api-access-qs5qk\") pod \"prometheus-k8s-0\" (UID: \"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.240310 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.240233 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 08:59:55.518748 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.518701 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 16 08:59:55.520782 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:59:55.520754 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ec9455_ea82_4a0f_abb2_fd1d1af156ea.slice/crio-c5dacada7b095e88a1cc1d5dd95b40601d04cc6b7d742f7c7a9ab2148658ba90 WatchSource:0}: Error finding container c5dacada7b095e88a1cc1d5dd95b40601d04cc6b7d742f7c7a9ab2148658ba90: Status 404 returned error can't find the container with id c5dacada7b095e88a1cc1d5dd95b40601d04cc6b7d742f7c7a9ab2148658ba90 Sep 16 08:59:55.873252 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.873221 2564 generic.go:356] "Generic (PLEG): container finished" podID="d0ec9455-ea82-4a0f-abb2-fd1d1af156ea" containerID="19c1e38943ead20fe4ce4dbbb41caf2f071ab56255f91e6330dd65de8ae8696e" exitCode=0 Sep 16 08:59:55.873631 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.873259 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea","Type":"ContainerDied","Data":"19c1e38943ead20fe4ce4dbbb41caf2f071ab56255f91e6330dd65de8ae8696e"} Sep 16 08:59:55.873631 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.873309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea","Type":"ContainerStarted","Data":"c5dacada7b095e88a1cc1d5dd95b40601d04cc6b7d742f7c7a9ab2148658ba90"} Sep 16 08:59:55.916424 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:55.916128 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94999bd8-1793-49bc-a33a-96982799c5ff" path="/var/lib/kubelet/pods/94999bd8-1793-49bc-a33a-96982799c5ff/volumes" Sep 16 08:59:56.881146 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:56.881110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea","Type":"ContainerStarted","Data":"b9ec3b9e690543efd673a1e62b0cc8a781adb2e74ceb51b4729288033a78c6f7"} Sep 16 08:59:56.881633 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:56.881175 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea","Type":"ContainerStarted","Data":"8782a6fa67931f1dfa39f3a55eca319a732395122fff2eb8c68e1db7c0212fec"} Sep 16 08:59:56.881633 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:56.881202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea","Type":"ContainerStarted","Data":"cd6f47ecef092e7f91c4bbaab874237b99dfaec148f2f4c88b20d310dc797f41"} Sep 16 08:59:56.881633 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:56.881225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea","Type":"ContainerStarted","Data":"d17e584c21ef7cadfdaffdcf51a08a9e057b51cf2364e2f1295ce37b40d300a8"} Sep 16 08:59:56.881633 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:56.881250 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea","Type":"ContainerStarted","Data":"357b04229cbfb0e7d3203caefe94c23a2064101379d4dc6f7cce90472a37ec9f"} Sep 16 08:59:56.881633 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:56.881273 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec9455-ea82-4a0f-abb2-fd1d1af156ea","Type":"ContainerStarted","Data":"512646a15f7fe613328cb7ef088a47995d860e7f95d32885bb065edb89b94c49"} Sep 16 08:59:56.912896 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:56.912803 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.895606571 podStartE2EDuration="2.912784967s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.178396ms" isStatefulPod=false podCreationTimestamp="2026-09-16 08:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:59:56.911015418 +0000 UTC m=+153.498777013" watchObservedRunningTime="2026-09-16 08:59:56.912784967 +0000 UTC m=+153.500546561" Sep 16 08:59:57.770254 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.770220 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-766dffc5d-bdxvk"] Sep 16 08:59:57.773086 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.773069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.787617 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.787591 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766dffc5d-bdxvk"] Sep 16 08:59:57.835197 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.835169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-oauth-serving-cert\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.835347 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.835209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-oauth-config\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.835347 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.835230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz9br\" (UniqueName: \"kubernetes.io/projected/80042665-e89e-44ff-a526-79f91782c2ec-kube-api-access-dz9br\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.835347 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.835291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-console-config\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.835347 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.835308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-serving-cert\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.835347 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.835321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-service-ca\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.835347 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.835335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-trusted-ca-bundle\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.936510 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.936479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-oauth-config\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.936986 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.936520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz9br\" (UniqueName: \"kubernetes.io/projected/80042665-e89e-44ff-a526-79f91782c2ec-kube-api-access-dz9br\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.936986 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.936716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-console-config\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.936986 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.936742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-serving-cert\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.936986 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.936764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-service-ca\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.936986 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.936793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-trusted-ca-bundle\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.937268 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.937193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-oauth-serving-cert\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.937688 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.937654 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-service-ca\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.938079 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.938050 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-oauth-serving-cert\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.938208 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.938076 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-trusted-ca-bundle\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.938208 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.938049 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-console-config\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.939341 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.939323 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-oauth-config\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.940092 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.940069 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-serving-cert\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:57.945287 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:57.945266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz9br\" (UniqueName: \"kubernetes.io/projected/80042665-e89e-44ff-a526-79f91782c2ec-kube-api-access-dz9br\") pod \"console-766dffc5d-bdxvk\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:58.082974 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:58.082892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 08:59:58.353536 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:58.353500 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766dffc5d-bdxvk"] Sep 16 08:59:58.356055 ip-10-0-141-124 kubenswrapper[2564]: W0916 08:59:58.356028 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80042665_e89e_44ff_a526_79f91782c2ec.slice/crio-9e25f457e0ce6b37b1283432491166f18ae73a0da3ac7b0d31aa3465858166e7 WatchSource:0}: Error finding container 9e25f457e0ce6b37b1283432491166f18ae73a0da3ac7b0d31aa3465858166e7: Status 404 returned error can't find the container with id 9e25f457e0ce6b37b1283432491166f18ae73a0da3ac7b0d31aa3465858166e7 Sep 16 08:59:58.891567 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:58.891532 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766dffc5d-bdxvk" event={"ID":"80042665-e89e-44ff-a526-79f91782c2ec","Type":"ContainerStarted","Data":"e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d"} Sep 16 08:59:58.891751 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:58.891591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766dffc5d-bdxvk" event={"ID":"80042665-e89e-44ff-a526-79f91782c2ec","Type":"ContainerStarted","Data":"9e25f457e0ce6b37b1283432491166f18ae73a0da3ac7b0d31aa3465858166e7"} Sep 16 08:59:58.910973 ip-10-0-141-124 kubenswrapper[2564]: I0916 08:59:58.910924 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-766dffc5d-bdxvk" podStartSLOduration=1.9109087169999999 podStartE2EDuration="1.910908717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 08:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 08:59:58.909529443 +0000 UTC m=+155.497291037" watchObservedRunningTime="2026-09-16 08:59:58.910908717 +0000 UTC m=+155.498670310" Sep 16 09:00:00.240739 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:00.240702 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 09:00:08.083486 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:08.083446 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 09:00:08.084074 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:08.083517 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 09:00:08.088271 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:08.088246 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 09:00:08.938239 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:08.938211 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 09:00:08.982797 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:08.982761 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67fdcb9cc8-pxvh4"] Sep 16 09:00:34.002697 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.002655 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67fdcb9cc8-pxvh4" podUID="b292d055-40e9-461c-9984-dc50860728f2" containerName="console" containerID="cri-o://69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8" gracePeriod=15 Sep 16 09:00:34.239516 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.239491 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 09:00:34.267475 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.267394 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-oauth-serving-cert\") pod \"b292d055-40e9-461c-9984-dc50860728f2\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " Sep 16 09:00:34.267475 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.267448 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-service-ca\") pod \"b292d055-40e9-461c-9984-dc50860728f2\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " Sep 16 09:00:34.267708 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.267489 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-trusted-ca-bundle\") pod \"b292d055-40e9-461c-9984-dc50860728f2\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " Sep 16 09:00:34.267708 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.267534 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-serving-cert\") pod \"b292d055-40e9-461c-9984-dc50860728f2\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " Sep 16 09:00:34.267708 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.267559 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-oauth-config\") pod \"b292d055-40e9-461c-9984-dc50860728f2\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " Sep 16 09:00:34.267708 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.267602 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-console-config\") pod \"b292d055-40e9-461c-9984-dc50860728f2\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " Sep 16 09:00:34.267708 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.267648 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnpvw\" (UniqueName: \"kubernetes.io/projected/b292d055-40e9-461c-9984-dc50860728f2-kube-api-access-nnpvw\") pod \"b292d055-40e9-461c-9984-dc50860728f2\" (UID: \"b292d055-40e9-461c-9984-dc50860728f2\") " Sep 16 09:00:34.267992 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.267829 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b292d055-40e9-461c-9984-dc50860728f2" (UID: "b292d055-40e9-461c-9984-dc50860728f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:00:34.267992 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.267933 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "b292d055-40e9-461c-9984-dc50860728f2" (UID: "b292d055-40e9-461c-9984-dc50860728f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:00:34.268108 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.268031 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-oauth-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:00:34.268108 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.268049 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-service-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:00:34.268405 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.268371 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-console-config" (OuterVolumeSpecName: "console-config") pod "b292d055-40e9-461c-9984-dc50860728f2" (UID: "b292d055-40e9-461c-9984-dc50860728f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:00:34.268515 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.268491 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b292d055-40e9-461c-9984-dc50860728f2" (UID: "b292d055-40e9-461c-9984-dc50860728f2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:00:34.269770 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.269748 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b292d055-40e9-461c-9984-dc50860728f2" (UID: "b292d055-40e9-461c-9984-dc50860728f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 09:00:34.270284 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.270263 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b292d055-40e9-461c-9984-dc50860728f2-kube-api-access-nnpvw" (OuterVolumeSpecName: "kube-api-access-nnpvw") pod "b292d055-40e9-461c-9984-dc50860728f2" (UID: "b292d055-40e9-461c-9984-dc50860728f2"). InnerVolumeSpecName "kube-api-access-nnpvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 09:00:34.270402 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.270368 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b292d055-40e9-461c-9984-dc50860728f2" (UID: "b292d055-40e9-461c-9984-dc50860728f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 09:00:34.368498 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.368467 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:00:34.368498 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.368491 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b292d055-40e9-461c-9984-dc50860728f2-console-oauth-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:00:34.368498 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.368500 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-console-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:00:34.368718 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.368511 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnpvw\" (UniqueName: \"kubernetes.io/projected/b292d055-40e9-461c-9984-dc50860728f2-kube-api-access-nnpvw\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:00:34.368718 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:34.368519 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b292d055-40e9-461c-9984-dc50860728f2-trusted-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:00:35.045647 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.045612 2564 generic.go:356] "Generic (PLEG): container finished" podID="b292d055-40e9-461c-9984-dc50860728f2" containerID="69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8" exitCode=0 Sep 16 09:00:35.046117 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.045651 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67fdcb9cc8-pxvh4" Sep 16 09:00:35.046117 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.045703 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67fdcb9cc8-pxvh4" event={"ID":"b292d055-40e9-461c-9984-dc50860728f2","Type":"ContainerDied","Data":"69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8"} Sep 16 09:00:35.046117 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.045751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67fdcb9cc8-pxvh4" event={"ID":"b292d055-40e9-461c-9984-dc50860728f2","Type":"ContainerDied","Data":"e89b3a053e0326aa7a1c7aa11c9c662e2f13aa4cebed5deff64a56e02f2971f0"} Sep 16 09:00:35.046117 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.045772 2564 scope.go:117] "RemoveContainer" containerID="69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8" Sep 16 09:00:35.054685 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.054668 2564 scope.go:117] "RemoveContainer" containerID="69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8" Sep 16 09:00:35.054982 ip-10-0-141-124 kubenswrapper[2564]: E0916 09:00:35.054965 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8\": container with ID starting with 69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8 not found: ID does not exist" containerID="69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8" Sep 16 09:00:35.055030 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.054991 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8"} err="failed to get container status \"69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8\": rpc error: code = NotFound desc = could not find container \"69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8\": container with ID starting with 69bd985d4c82c7ee778ac515da363b90dd4e65842b49f147d3fc9a814c5eeaa8 not found: ID does not exist" Sep 16 09:00:35.067749 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.067725 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67fdcb9cc8-pxvh4"] Sep 16 09:00:35.071554 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.071529 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67fdcb9cc8-pxvh4"] Sep 16 09:00:35.916753 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:35.916720 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b292d055-40e9-461c-9984-dc50860728f2" path="/var/lib/kubelet/pods/b292d055-40e9-461c-9984-dc50860728f2/volumes" Sep 16 09:00:55.240460 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:55.240394 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 09:00:55.256039 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:55.256010 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 09:00:56.156642 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:00:56.156612 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 16 09:01:21.435936 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.435904 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c87b84b64-djxv8"] Sep 16 09:01:21.436440 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.436418 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b292d055-40e9-461c-9984-dc50860728f2" containerName="console" Sep 16 09:01:21.436512 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.436445 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b292d055-40e9-461c-9984-dc50860728f2" containerName="console" Sep 16 09:01:21.436564 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.436536 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b292d055-40e9-461c-9984-dc50860728f2" containerName="console" Sep 16 09:01:21.439319 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.439298 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.448401 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.448378 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c87b84b64-djxv8"] Sep 16 09:01:21.492143 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.492111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-oauth-config\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.492302 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.492156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-service-ca\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.492302 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.492187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-oauth-serving-cert\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.492302 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.492265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-serving-cert\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.492302 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.492297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7vf7\" (UniqueName: \"kubernetes.io/projected/14edb4d0-d4fa-410c-9c24-9cde31161535-kube-api-access-c7vf7\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.492455 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.492316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-trusted-ca-bundle\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.492455 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.492346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-console-config\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.592975 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.592927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-serving-cert\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.593157 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.592975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7vf7\" (UniqueName: \"kubernetes.io/projected/14edb4d0-d4fa-410c-9c24-9cde31161535-kube-api-access-c7vf7\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.593157 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.593014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-trusted-ca-bundle\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.593157 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.593035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-console-config\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.593157 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.593067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-oauth-config\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.593336 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.593192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-service-ca\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.593336 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.593261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-oauth-serving-cert\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.593935 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.593914 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-service-ca\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.593935 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.593922 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-console-config\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.594072 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.593946 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-oauth-serving-cert\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.594072 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.594051 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-trusted-ca-bundle\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.595614 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.595583 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-serving-cert\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.595614 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.595609 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-oauth-config\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.601186 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.601167 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7vf7\" (UniqueName: \"kubernetes.io/projected/14edb4d0-d4fa-410c-9c24-9cde31161535-kube-api-access-c7vf7\") pod \"console-6c87b84b64-djxv8\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:21.749677 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:21.749594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:22.021143 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:22.021100 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c87b84b64-djxv8"] Sep 16 09:01:22.023619 ip-10-0-141-124 kubenswrapper[2564]: W0916 09:01:22.023578 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14edb4d0_d4fa_410c_9c24_9cde31161535.slice/crio-90e6d4ee86b2783b8769344b5a9ca02698788605e289bfd68e6470e2f2818889 WatchSource:0}: Error finding container 90e6d4ee86b2783b8769344b5a9ca02698788605e289bfd68e6470e2f2818889: Status 404 returned error can't find the container with id 90e6d4ee86b2783b8769344b5a9ca02698788605e289bfd68e6470e2f2818889 Sep 16 09:01:22.247405 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:22.247361 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c87b84b64-djxv8" event={"ID":"14edb4d0-d4fa-410c-9c24-9cde31161535","Type":"ContainerStarted","Data":"7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9"} Sep 16 09:01:22.247576 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:22.247426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c87b84b64-djxv8" event={"ID":"14edb4d0-d4fa-410c-9c24-9cde31161535","Type":"ContainerStarted","Data":"90e6d4ee86b2783b8769344b5a9ca02698788605e289bfd68e6470e2f2818889"} Sep 16 09:01:22.264880 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:22.264806 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c87b84b64-djxv8" podStartSLOduration=1.26479051 podStartE2EDuration="1.26479051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 09:01:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 09:01:22.264201454 +0000 UTC m=+238.851963060" watchObservedRunningTime="2026-09-16 09:01:22.26479051 +0000 UTC m=+238.852552104" Sep 16 09:01:31.749842 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:31.749798 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:31.750369 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:31.749889 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:31.754899 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:31.754872 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:32.291174 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:32.291142 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:01:32.340495 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:32.340463 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766dffc5d-bdxvk"] Sep 16 09:01:57.361468 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.361356 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-766dffc5d-bdxvk" podUID="80042665-e89e-44ff-a526-79f91782c2ec" containerName="console" containerID="cri-o://e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d" gracePeriod=15 Sep 16 09:01:57.605329 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.605301 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 09:01:57.715537 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.715501 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz9br\" (UniqueName: \"kubernetes.io/projected/80042665-e89e-44ff-a526-79f91782c2ec-kube-api-access-dz9br\") pod \"80042665-e89e-44ff-a526-79f91782c2ec\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " Sep 16 09:01:57.715537 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.715539 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-oauth-config\") pod \"80042665-e89e-44ff-a526-79f91782c2ec\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " Sep 16 09:01:57.715784 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.715572 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-serving-cert\") pod \"80042665-e89e-44ff-a526-79f91782c2ec\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " Sep 16 09:01:57.715784 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.715617 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-oauth-serving-cert\") pod \"80042665-e89e-44ff-a526-79f91782c2ec\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " Sep 16 09:01:57.715784 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.715641 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-trusted-ca-bundle\") pod \"80042665-e89e-44ff-a526-79f91782c2ec\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " Sep 16 09:01:57.715784 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.715708 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-service-ca\") pod \"80042665-e89e-44ff-a526-79f91782c2ec\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " Sep 16 09:01:57.715784 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.715746 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-console-config\") pod \"80042665-e89e-44ff-a526-79f91782c2ec\" (UID: \"80042665-e89e-44ff-a526-79f91782c2ec\") " Sep 16 09:01:57.716145 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.716119 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "80042665-e89e-44ff-a526-79f91782c2ec" (UID: "80042665-e89e-44ff-a526-79f91782c2ec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:01:57.716214 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.716145 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-service-ca" (OuterVolumeSpecName: "service-ca") pod "80042665-e89e-44ff-a526-79f91782c2ec" (UID: "80042665-e89e-44ff-a526-79f91782c2ec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:01:57.716214 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.716165 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "80042665-e89e-44ff-a526-79f91782c2ec" (UID: "80042665-e89e-44ff-a526-79f91782c2ec"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:01:57.716380 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.716359 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-console-config" (OuterVolumeSpecName: "console-config") pod "80042665-e89e-44ff-a526-79f91782c2ec" (UID: "80042665-e89e-44ff-a526-79f91782c2ec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:01:57.717747 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.717727 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80042665-e89e-44ff-a526-79f91782c2ec-kube-api-access-dz9br" (OuterVolumeSpecName: "kube-api-access-dz9br") pod "80042665-e89e-44ff-a526-79f91782c2ec" (UID: "80042665-e89e-44ff-a526-79f91782c2ec"). InnerVolumeSpecName "kube-api-access-dz9br". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 09:01:57.718235 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.718208 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "80042665-e89e-44ff-a526-79f91782c2ec" (UID: "80042665-e89e-44ff-a526-79f91782c2ec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 09:01:57.718235 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.718228 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "80042665-e89e-44ff-a526-79f91782c2ec" (UID: "80042665-e89e-44ff-a526-79f91782c2ec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 09:01:57.816698 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.816655 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-service-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:01:57.816698 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.816695 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-console-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:01:57.816925 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.816710 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz9br\" (UniqueName: \"kubernetes.io/projected/80042665-e89e-44ff-a526-79f91782c2ec-kube-api-access-dz9br\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:01:57.816925 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.816723 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-oauth-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:01:57.816925 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.816739 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80042665-e89e-44ff-a526-79f91782c2ec-console-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:01:57.816925 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.816752 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-oauth-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:01:57.816925 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:57.816764 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80042665-e89e-44ff-a526-79f91782c2ec-trusted-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:01:58.396856 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:58.396816 2564 generic.go:356] "Generic (PLEG): container finished" podID="80042665-e89e-44ff-a526-79f91782c2ec" containerID="e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d" exitCode=0 Sep 16 09:01:58.397243 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:58.396886 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766dffc5d-bdxvk" Sep 16 09:01:58.397243 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:58.396905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766dffc5d-bdxvk" event={"ID":"80042665-e89e-44ff-a526-79f91782c2ec","Type":"ContainerDied","Data":"e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d"} Sep 16 09:01:58.397243 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:58.396962 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766dffc5d-bdxvk" event={"ID":"80042665-e89e-44ff-a526-79f91782c2ec","Type":"ContainerDied","Data":"9e25f457e0ce6b37b1283432491166f18ae73a0da3ac7b0d31aa3465858166e7"} Sep 16 09:01:58.397243 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:58.396983 2564 scope.go:117] "RemoveContainer" containerID="e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d" Sep 16 09:01:58.405241 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:58.405204 2564 scope.go:117] "RemoveContainer" containerID="e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d" Sep 16 09:01:58.405534 ip-10-0-141-124 kubenswrapper[2564]: E0916 09:01:58.405515 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d\": container with ID starting with e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d not found: ID does not exist" containerID="e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d" Sep 16 09:01:58.405588 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:58.405543 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d"} err="failed to get container status \"e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d\": rpc error: code = NotFound desc = could not find container \"e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d\": container with ID starting with e4d05eda56a79c8cea130c3de0dae7932327f62ed78be226543247b064866b5d not found: ID does not exist" Sep 16 09:01:58.414089 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:58.414063 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766dffc5d-bdxvk"] Sep 16 09:01:58.417837 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:58.417814 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-766dffc5d-bdxvk"] Sep 16 09:01:59.916265 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:01:59.916231 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80042665-e89e-44ff-a526-79f91782c2ec" path="/var/lib/kubelet/pods/80042665-e89e-44ff-a526-79f91782c2ec/volumes" Sep 16 09:02:23.807055 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:02:23.807026 2564 kubelet.go:1648] "Image garbage collection succeeded" Sep 16 09:03:32.724452 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.724371 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2"] Sep 16 09:03:32.724946 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.724733 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80042665-e89e-44ff-a526-79f91782c2ec" containerName="console" Sep 16 09:03:32.724946 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.724745 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80042665-e89e-44ff-a526-79f91782c2ec" containerName="console" Sep 16 09:03:32.724946 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.724808 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="80042665-e89e-44ff-a526-79f91782c2ec" containerName="console" Sep 16 09:03:32.727907 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.727889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" Sep 16 09:03:32.730640 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.730608 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 16 09:03:32.730782 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.730610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-qv5vx\"" Sep 16 09:03:32.731676 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.731659 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 16 09:03:32.735411 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.735076 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2"] Sep 16 09:03:32.840892 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.840834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe8ad136-a6ae-43d1-849e-ad1345803468-tmp\") pod \"jobset-operator-5bc45f897-lmfw2\" (UID: \"fe8ad136-a6ae-43d1-849e-ad1345803468\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" Sep 16 09:03:32.841068 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.840942 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqz8z\" (UniqueName: \"kubernetes.io/projected/fe8ad136-a6ae-43d1-849e-ad1345803468-kube-api-access-gqz8z\") pod \"jobset-operator-5bc45f897-lmfw2\" (UID: \"fe8ad136-a6ae-43d1-849e-ad1345803468\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" Sep 16 09:03:32.941429 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.941389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe8ad136-a6ae-43d1-849e-ad1345803468-tmp\") pod \"jobset-operator-5bc45f897-lmfw2\" (UID: \"fe8ad136-a6ae-43d1-849e-ad1345803468\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" Sep 16 09:03:32.941777 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.941756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqz8z\" (UniqueName: \"kubernetes.io/projected/fe8ad136-a6ae-43d1-849e-ad1345803468-kube-api-access-gqz8z\") pod \"jobset-operator-5bc45f897-lmfw2\" (UID: \"fe8ad136-a6ae-43d1-849e-ad1345803468\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" Sep 16 09:03:32.942091 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.942064 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe8ad136-a6ae-43d1-849e-ad1345803468-tmp\") pod \"jobset-operator-5bc45f897-lmfw2\" (UID: \"fe8ad136-a6ae-43d1-849e-ad1345803468\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" Sep 16 09:03:32.950142 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:32.950104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqz8z\" (UniqueName: \"kubernetes.io/projected/fe8ad136-a6ae-43d1-849e-ad1345803468-kube-api-access-gqz8z\") pod \"jobset-operator-5bc45f897-lmfw2\" (UID: \"fe8ad136-a6ae-43d1-849e-ad1345803468\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" Sep 16 09:03:33.058370 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:33.058256 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" Sep 16 09:03:33.330363 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:33.330339 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2"] Sep 16 09:03:33.333059 ip-10-0-141-124 kubenswrapper[2564]: W0916 09:03:33.333030 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe8ad136_a6ae_43d1_849e_ad1345803468.slice/crio-4e84f4aa558b4a863d3e913fe5cedaf7f5e1f7f0adeac1aa1d5c9d589d37c4ef WatchSource:0}: Error finding container 4e84f4aa558b4a863d3e913fe5cedaf7f5e1f7f0adeac1aa1d5c9d589d37c4ef: Status 404 returned error can't find the container with id 4e84f4aa558b4a863d3e913fe5cedaf7f5e1f7f0adeac1aa1d5c9d589d37c4ef Sep 16 09:03:33.334549 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:33.334529 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 09:03:33.794518 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:33.794471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" event={"ID":"fe8ad136-a6ae-43d1-849e-ad1345803468","Type":"ContainerStarted","Data":"4e84f4aa558b4a863d3e913fe5cedaf7f5e1f7f0adeac1aa1d5c9d589d37c4ef"} Sep 16 09:03:38.818886 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:38.818831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" event={"ID":"fe8ad136-a6ae-43d1-849e-ad1345803468","Type":"ContainerStarted","Data":"5062cdf2485785d0930884b071cd38f4f6e7f0234042f04b03a9042b484dbe3c"} Sep 16 09:03:38.836499 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:38.836450 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-lmfw2" podStartSLOduration=2.139913836 podStartE2EDuration="6.836433141s" totalImagesPullingTime="4.696519305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 09:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 09:03:38.835214948 +0000 UTC m=+375.422976541" watchObservedRunningTime="2026-09-16 09:03:38.836433141 +0000 UTC m=+375.424194734" Sep 16 09:03:44.670759 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.670722 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c89968cd-mkgdz"] Sep 16 09:03:44.674361 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.674328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.684357 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.684326 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c89968cd-mkgdz"] Sep 16 09:03:44.851135 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.851097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1415d6c8-d242-490e-9552-167d3aff1766-console-serving-cert\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.851135 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.851133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-service-ca\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.851385 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.851163 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-trusted-ca-bundle\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.851385 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.851246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8s9p\" (UniqueName: \"kubernetes.io/projected/1415d6c8-d242-490e-9552-167d3aff1766-kube-api-access-g8s9p\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.851385 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.851293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-console-config\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.851385 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.851359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1415d6c8-d242-490e-9552-167d3aff1766-console-oauth-config\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.851385 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.851383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-oauth-serving-cert\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.952111 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.952013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1415d6c8-d242-490e-9552-167d3aff1766-console-oauth-config\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.952111 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.952054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-oauth-serving-cert\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.952338 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.952178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1415d6c8-d242-490e-9552-167d3aff1766-console-serving-cert\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.952338 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.952204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-service-ca\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.952338 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.952233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-trusted-ca-bundle\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.952499 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.952381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8s9p\" (UniqueName: \"kubernetes.io/projected/1415d6c8-d242-490e-9552-167d3aff1766-kube-api-access-g8s9p\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.952499 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.952435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-console-config\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.952842 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.952807 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-oauth-serving-cert\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.952842 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.952843 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-service-ca\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.953145 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.953123 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-console-config\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.953220 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.953127 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1415d6c8-d242-490e-9552-167d3aff1766-trusted-ca-bundle\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.954578 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.954550 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1415d6c8-d242-490e-9552-167d3aff1766-console-oauth-config\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.954668 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.954653 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1415d6c8-d242-490e-9552-167d3aff1766-console-serving-cert\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.960463 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.960440 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8s9p\" (UniqueName: \"kubernetes.io/projected/1415d6c8-d242-490e-9552-167d3aff1766-kube-api-access-g8s9p\") pod \"console-84c89968cd-mkgdz\" (UID: \"1415d6c8-d242-490e-9552-167d3aff1766\") " pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:44.984523 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:44.984486 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:45.257178 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:45.257155 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c89968cd-mkgdz"] Sep 16 09:03:45.259767 ip-10-0-141-124 kubenswrapper[2564]: W0916 09:03:45.259742 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1415d6c8_d242_490e_9552_167d3aff1766.slice/crio-34e634520a7fdc4659ba84fb6bbff7663f3ab8eb8bc32cb067c431a5d950018f WatchSource:0}: Error finding container 34e634520a7fdc4659ba84fb6bbff7663f3ab8eb8bc32cb067c431a5d950018f: Status 404 returned error can't find the container with id 34e634520a7fdc4659ba84fb6bbff7663f3ab8eb8bc32cb067c431a5d950018f Sep 16 09:03:45.850645 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:45.850602 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c89968cd-mkgdz" event={"ID":"1415d6c8-d242-490e-9552-167d3aff1766","Type":"ContainerStarted","Data":"afecfab6e116924e9888f4428ea66f7d71626293de0bd74ccf0d298344b73f9f"} Sep 16 09:03:45.851078 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:45.850659 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c89968cd-mkgdz" event={"ID":"1415d6c8-d242-490e-9552-167d3aff1766","Type":"ContainerStarted","Data":"34e634520a7fdc4659ba84fb6bbff7663f3ab8eb8bc32cb067c431a5d950018f"} Sep 16 09:03:45.868893 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:45.868828 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c89968cd-mkgdz" podStartSLOduration=1.868810267 podStartE2EDuration="1.868810267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 09:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 09:03:45.86749479 +0000 UTC m=+382.455256385" watchObservedRunningTime="2026-09-16 09:03:45.868810267 +0000 UTC m=+382.456571858" Sep 16 09:03:54.984824 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:54.984786 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:54.985300 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:54.984880 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:54.989422 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:54.989395 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:55.898020 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:55.897975 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c89968cd-mkgdz" Sep 16 09:03:55.941978 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:03:55.941943 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c87b84b64-djxv8"] Sep 16 09:04:20.967905 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:20.967833 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c87b84b64-djxv8" podUID="14edb4d0-d4fa-410c-9c24-9cde31161535" containerName="console" containerID="cri-o://7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9" gracePeriod=15 Sep 16 09:04:21.206761 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.206734 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:04:21.281794 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.281703 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-service-ca\") pod \"14edb4d0-d4fa-410c-9c24-9cde31161535\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " Sep 16 09:04:21.281794 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.281767 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7vf7\" (UniqueName: \"kubernetes.io/projected/14edb4d0-d4fa-410c-9c24-9cde31161535-kube-api-access-c7vf7\") pod \"14edb4d0-d4fa-410c-9c24-9cde31161535\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " Sep 16 09:04:21.282045 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.281807 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-oauth-config\") pod \"14edb4d0-d4fa-410c-9c24-9cde31161535\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " Sep 16 09:04:21.282045 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.281826 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-trusted-ca-bundle\") pod \"14edb4d0-d4fa-410c-9c24-9cde31161535\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " Sep 16 09:04:21.282045 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.281845 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-serving-cert\") pod \"14edb4d0-d4fa-410c-9c24-9cde31161535\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " Sep 16 09:04:21.282045 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.281881 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-console-config\") pod \"14edb4d0-d4fa-410c-9c24-9cde31161535\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " Sep 16 09:04:21.282045 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.281926 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-oauth-serving-cert\") pod \"14edb4d0-d4fa-410c-9c24-9cde31161535\" (UID: \"14edb4d0-d4fa-410c-9c24-9cde31161535\") " Sep 16 09:04:21.282301 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.282268 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-service-ca" (OuterVolumeSpecName: "service-ca") pod "14edb4d0-d4fa-410c-9c24-9cde31161535" (UID: "14edb4d0-d4fa-410c-9c24-9cde31161535"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:04:21.282451 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.282425 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14edb4d0-d4fa-410c-9c24-9cde31161535" (UID: "14edb4d0-d4fa-410c-9c24-9cde31161535"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:04:21.282528 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.282351 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-console-config" (OuterVolumeSpecName: "console-config") pod "14edb4d0-d4fa-410c-9c24-9cde31161535" (UID: "14edb4d0-d4fa-410c-9c24-9cde31161535"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:04:21.282528 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.282500 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14edb4d0-d4fa-410c-9c24-9cde31161535" (UID: "14edb4d0-d4fa-410c-9c24-9cde31161535"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 16 09:04:21.284087 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.284054 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14edb4d0-d4fa-410c-9c24-9cde31161535" (UID: "14edb4d0-d4fa-410c-9c24-9cde31161535"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 09:04:21.284087 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.284068 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14edb4d0-d4fa-410c-9c24-9cde31161535" (UID: "14edb4d0-d4fa-410c-9c24-9cde31161535"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 16 09:04:21.284087 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.284062 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14edb4d0-d4fa-410c-9c24-9cde31161535-kube-api-access-c7vf7" (OuterVolumeSpecName: "kube-api-access-c7vf7") pod "14edb4d0-d4fa-410c-9c24-9cde31161535" (UID: "14edb4d0-d4fa-410c-9c24-9cde31161535"). InnerVolumeSpecName "kube-api-access-c7vf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 09:04:21.383457 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.383419 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7vf7\" (UniqueName: \"kubernetes.io/projected/14edb4d0-d4fa-410c-9c24-9cde31161535-kube-api-access-c7vf7\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:04:21.383457 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.383449 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-oauth-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:04:21.383457 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.383458 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-trusted-ca-bundle\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:04:21.383692 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.383468 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14edb4d0-d4fa-410c-9c24-9cde31161535-console-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:04:21.383692 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.383478 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-console-config\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:04:21.383692 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.383486 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-oauth-serving-cert\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:04:21.383692 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:21.383494 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14edb4d0-d4fa-410c-9c24-9cde31161535-service-ca\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:04:22.007053 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:22.007016 2564 generic.go:356] "Generic (PLEG): container finished" podID="14edb4d0-d4fa-410c-9c24-9cde31161535" containerID="7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9" exitCode=0 Sep 16 09:04:22.007443 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:22.007063 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c87b84b64-djxv8" Sep 16 09:04:22.007443 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:22.007072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c87b84b64-djxv8" event={"ID":"14edb4d0-d4fa-410c-9c24-9cde31161535","Type":"ContainerDied","Data":"7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9"} Sep 16 09:04:22.007443 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:22.007119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c87b84b64-djxv8" event={"ID":"14edb4d0-d4fa-410c-9c24-9cde31161535","Type":"ContainerDied","Data":"90e6d4ee86b2783b8769344b5a9ca02698788605e289bfd68e6470e2f2818889"} Sep 16 09:04:22.007443 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:22.007146 2564 scope.go:117] "RemoveContainer" containerID="7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9" Sep 16 09:04:22.015559 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:22.015516 2564 scope.go:117] "RemoveContainer" containerID="7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9" Sep 16 09:04:22.015829 ip-10-0-141-124 kubenswrapper[2564]: E0916 09:04:22.015810 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9\": container with ID starting with 7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9 not found: ID does not exist" containerID="7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9" Sep 16 09:04:22.015917 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:22.015842 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9"} err="failed to get container status \"7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9\": rpc error: code = NotFound desc = could not find container \"7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9\": container with ID starting with 7ce32993eb65ca3c3e13a0d23f62fc4c9e63bf5b279fc48142b7c9e4042757e9 not found: ID does not exist" Sep 16 09:04:22.022656 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:22.022631 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c87b84b64-djxv8"] Sep 16 09:04:22.024906 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:22.024883 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c87b84b64-djxv8"] Sep 16 09:04:23.916665 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:04:23.916632 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14edb4d0-d4fa-410c-9c24-9cde31161535" path="/var/lib/kubelet/pods/14edb4d0-d4fa-410c-9c24-9cde31161535/volumes" Sep 16 09:05:35.659989 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.659952 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj"] Sep 16 09:05:35.660501 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.660282 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14edb4d0-d4fa-410c-9c24-9cde31161535" containerName="console" Sep 16 09:05:35.660501 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.660292 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14edb4d0-d4fa-410c-9c24-9cde31161535" containerName="console" Sep 16 09:05:35.660501 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.660356 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14edb4d0-d4fa-410c-9c24-9cde31161535" containerName="console" Sep 16 09:05:35.662311 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.662295 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" Sep 16 09:05:35.665008 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.664987 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-stbvh\"/\"default-dockercfg-78k5q\"" Sep 16 09:05:35.665130 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.665111 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-stbvh\"/\"kube-root-ca.crt\"" Sep 16 09:05:35.666035 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.666011 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-stbvh\"/\"openshift-service-ca.crt\"" Sep 16 09:05:35.672399 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.672374 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj"] Sep 16 09:05:35.706082 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.706053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9q6z\" (UniqueName: \"kubernetes.io/projected/06b5c652-7e53-4ee2-a517-3a21a6ff0c07-kube-api-access-k9q6z\") pod \"progression-enabled-node-0-0-9kmxj\" (UID: \"06b5c652-7e53-4ee2-a517-3a21a6ff0c07\") " pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" Sep 16 09:05:35.807542 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.807470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9q6z\" (UniqueName: \"kubernetes.io/projected/06b5c652-7e53-4ee2-a517-3a21a6ff0c07-kube-api-access-k9q6z\") pod \"progression-enabled-node-0-0-9kmxj\" (UID: \"06b5c652-7e53-4ee2-a517-3a21a6ff0c07\") " pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" Sep 16 09:05:35.816788 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.816751 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9q6z\" (UniqueName: \"kubernetes.io/projected/06b5c652-7e53-4ee2-a517-3a21a6ff0c07-kube-api-access-k9q6z\") pod \"progression-enabled-node-0-0-9kmxj\" (UID: \"06b5c652-7e53-4ee2-a517-3a21a6ff0c07\") " pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" Sep 16 09:05:35.974261 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:35.974155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" Sep 16 09:05:36.249197 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:36.249115 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj"] Sep 16 09:05:36.252071 ip-10-0-141-124 kubenswrapper[2564]: W0916 09:05:36.252039 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b5c652_7e53_4ee2_a517_3a21a6ff0c07.slice/crio-862ace72b0ef513e619b17522b033173a7c76219ea4cd9bb7576e31ff0e54297 WatchSource:0}: Error finding container 862ace72b0ef513e619b17522b033173a7c76219ea4cd9bb7576e31ff0e54297: Status 404 returned error can't find the container with id 862ace72b0ef513e619b17522b033173a7c76219ea4cd9bb7576e31ff0e54297 Sep 16 09:05:36.316656 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:05:36.316622 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" event={"ID":"06b5c652-7e53-4ee2-a517-3a21a6ff0c07","Type":"ContainerStarted","Data":"862ace72b0ef513e619b17522b033173a7c76219ea4cd9bb7576e31ff0e54297"} Sep 16 09:07:33.936308 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:33.936268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" event={"ID":"06b5c652-7e53-4ee2-a517-3a21a6ff0c07","Type":"ContainerStarted","Data":"cc1ebe0a4edade8a5e833f347a8f1cf27fe83f16d0363cf325c3689cab83c4cd"} Sep 16 09:07:33.936821 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:33.936391 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" Sep 16 09:07:33.972944 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:33.972853 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" podStartSLOduration=2.143429951 podStartE2EDuration="1m58.972831595s" totalImagesPullingTime="1m56.829401644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 09:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 09:07:33.970810718 +0000 UTC m=+610.558572312" watchObservedRunningTime="2026-09-16 09:07:33.972831595 +0000 UTC m=+610.560593190" Sep 16 09:07:35.944052 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:35.944018 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" Sep 16 09:07:56.941261 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:56.941217 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" podUID="06b5c652-7e53-4ee2-a517-3a21a6ff0c07" containerName="node" probeResult="failure" output="Get \"http://10.134.0.28:28080/metrics\": dial tcp 10.134.0.28:28080: connect: connection refused" Sep 16 09:07:57.044273 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:57.044240 2564 generic.go:356] "Generic (PLEG): container finished" podID="06b5c652-7e53-4ee2-a517-3a21a6ff0c07" containerID="cc1ebe0a4edade8a5e833f347a8f1cf27fe83f16d0363cf325c3689cab83c4cd" exitCode=0 Sep 16 09:07:57.044467 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:57.044313 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" event={"ID":"06b5c652-7e53-4ee2-a517-3a21a6ff0c07","Type":"ContainerDied","Data":"cc1ebe0a4edade8a5e833f347a8f1cf27fe83f16d0363cf325c3689cab83c4cd"} Sep 16 09:07:58.190457 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:58.190424 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" Sep 16 09:07:58.212815 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:58.212779 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9q6z\" (UniqueName: \"kubernetes.io/projected/06b5c652-7e53-4ee2-a517-3a21a6ff0c07-kube-api-access-k9q6z\") pod \"06b5c652-7e53-4ee2-a517-3a21a6ff0c07\" (UID: \"06b5c652-7e53-4ee2-a517-3a21a6ff0c07\") " Sep 16 09:07:58.215288 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:58.215258 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b5c652-7e53-4ee2-a517-3a21a6ff0c07-kube-api-access-k9q6z" (OuterVolumeSpecName: "kube-api-access-k9q6z") pod "06b5c652-7e53-4ee2-a517-3a21a6ff0c07" (UID: "06b5c652-7e53-4ee2-a517-3a21a6ff0c07"). InnerVolumeSpecName "kube-api-access-k9q6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 09:07:58.314016 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:58.313933 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9q6z\" (UniqueName: \"kubernetes.io/projected/06b5c652-7e53-4ee2-a517-3a21a6ff0c07-kube-api-access-k9q6z\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:07:59.054600 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:59.054551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" event={"ID":"06b5c652-7e53-4ee2-a517-3a21a6ff0c07","Type":"ContainerDied","Data":"862ace72b0ef513e619b17522b033173a7c76219ea4cd9bb7576e31ff0e54297"} Sep 16 09:07:59.054600 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:59.054582 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj" Sep 16 09:07:59.054854 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:07:59.054600 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="862ace72b0ef513e619b17522b033173a7c76219ea4cd9bb7576e31ff0e54297" Sep 16 09:08:00.099340 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.099308 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx"] Sep 16 09:08:00.099727 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.099653 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b5c652-7e53-4ee2-a517-3a21a6ff0c07" containerName="node" Sep 16 09:08:00.099727 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.099665 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b5c652-7e53-4ee2-a517-3a21a6ff0c07" containerName="node" Sep 16 09:08:00.099727 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.099724 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b5c652-7e53-4ee2-a517-3a21a6ff0c07" containerName="node" Sep 16 09:08:00.120563 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.120534 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx"] Sep 16 09:08:00.120704 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.120628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" Sep 16 09:08:00.123268 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.123237 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-stbvh\"/\"openshift-service-ca.crt\"" Sep 16 09:08:00.123268 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.123250 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-stbvh\"/\"kube-root-ca.crt\"" Sep 16 09:08:00.123484 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.123276 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-stbvh\"/\"default-dockercfg-78k5q\"" Sep 16 09:08:00.126612 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.126589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l88h9\" (UniqueName: \"kubernetes.io/projected/d85023b3-98a0-48e5-81aa-8b3da94ec000-kube-api-access-l88h9\") pod \"progression-disabled-node-0-0-r6znx\" (UID: \"d85023b3-98a0-48e5-81aa-8b3da94ec000\") " pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" Sep 16 09:08:00.227924 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.227883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l88h9\" (UniqueName: \"kubernetes.io/projected/d85023b3-98a0-48e5-81aa-8b3da94ec000-kube-api-access-l88h9\") pod \"progression-disabled-node-0-0-r6znx\" (UID: \"d85023b3-98a0-48e5-81aa-8b3da94ec000\") " pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" Sep 16 09:08:00.236642 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.236613 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l88h9\" (UniqueName: \"kubernetes.io/projected/d85023b3-98a0-48e5-81aa-8b3da94ec000-kube-api-access-l88h9\") pod \"progression-disabled-node-0-0-r6znx\" (UID: \"d85023b3-98a0-48e5-81aa-8b3da94ec000\") " pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" Sep 16 09:08:00.429901 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.429838 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" Sep 16 09:08:00.722251 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:00.721751 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx"] Sep 16 09:08:00.722823 ip-10-0-141-124 kubenswrapper[2564]: W0916 09:08:00.722788 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85023b3_98a0_48e5_81aa_8b3da94ec000.slice/crio-a4b89bb031082d1c0d237bc54823be36fde2ff96103f9abf99266436cd07d351 WatchSource:0}: Error finding container a4b89bb031082d1c0d237bc54823be36fde2ff96103f9abf99266436cd07d351: Status 404 returned error can't find the container with id a4b89bb031082d1c0d237bc54823be36fde2ff96103f9abf99266436cd07d351 Sep 16 09:08:01.067342 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:01.067249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" event={"ID":"d85023b3-98a0-48e5-81aa-8b3da94ec000","Type":"ContainerStarted","Data":"c4f3b54c135a404e8a1aeac9b08cae5426346a695c157b5eb98785e0e6dc752a"} Sep 16 09:08:01.067342 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:01.067306 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" event={"ID":"d85023b3-98a0-48e5-81aa-8b3da94ec000","Type":"ContainerStarted","Data":"a4b89bb031082d1c0d237bc54823be36fde2ff96103f9abf99266436cd07d351"} Sep 16 09:08:01.067342 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:01.067330 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" Sep 16 09:08:01.087797 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:01.087747 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" podStartSLOduration=1.087731662 podStartE2EDuration="1.087731662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 09:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 09:08:01.086195855 +0000 UTC m=+637.673957451" watchObservedRunningTime="2026-09-16 09:08:01.087731662 +0000 UTC m=+637.675493257" Sep 16 09:08:02.069957 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:02.069918 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" podUID="d85023b3-98a0-48e5-81aa-8b3da94ec000" containerName="node" probeResult="failure" output="Get \"http://10.134.0.29:28080/metrics\": dial tcp 10.134.0.29:28080: connect: connection refused" Sep 16 09:08:02.072748 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:02.072713 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" podUID="d85023b3-98a0-48e5-81aa-8b3da94ec000" containerName="node" probeResult="failure" output="Get \"http://10.134.0.29:28080/metrics\": dial tcp 10.134.0.29:28080: connect: connection refused" Sep 16 09:08:03.074190 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:03.074162 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" Sep 16 09:08:24.073096 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:24.073053 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" podUID="d85023b3-98a0-48e5-81aa-8b3da94ec000" containerName="node" probeResult="failure" output="Get \"http://10.134.0.29:28080/metrics\": dial tcp 10.134.0.29:28080: connect: connection refused" Sep 16 09:08:24.173433 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:24.173396 2564 generic.go:356] "Generic (PLEG): container finished" podID="d85023b3-98a0-48e5-81aa-8b3da94ec000" containerID="c4f3b54c135a404e8a1aeac9b08cae5426346a695c157b5eb98785e0e6dc752a" exitCode=0 Sep 16 09:08:24.173600 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:24.173469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" event={"ID":"d85023b3-98a0-48e5-81aa-8b3da94ec000","Type":"ContainerDied","Data":"c4f3b54c135a404e8a1aeac9b08cae5426346a695c157b5eb98785e0e6dc752a"} Sep 16 09:08:25.308660 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:25.308633 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" Sep 16 09:08:25.453398 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:25.453296 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l88h9\" (UniqueName: \"kubernetes.io/projected/d85023b3-98a0-48e5-81aa-8b3da94ec000-kube-api-access-l88h9\") pod \"d85023b3-98a0-48e5-81aa-8b3da94ec000\" (UID: \"d85023b3-98a0-48e5-81aa-8b3da94ec000\") " Sep 16 09:08:25.455354 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:25.455326 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85023b3-98a0-48e5-81aa-8b3da94ec000-kube-api-access-l88h9" (OuterVolumeSpecName: "kube-api-access-l88h9") pod "d85023b3-98a0-48e5-81aa-8b3da94ec000" (UID: "d85023b3-98a0-48e5-81aa-8b3da94ec000"). InnerVolumeSpecName "kube-api-access-l88h9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 09:08:25.554491 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:25.554450 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l88h9\" (UniqueName: \"kubernetes.io/projected/d85023b3-98a0-48e5-81aa-8b3da94ec000-kube-api-access-l88h9\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:08:26.184881 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:26.184770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" event={"ID":"d85023b3-98a0-48e5-81aa-8b3da94ec000","Type":"ContainerDied","Data":"a4b89bb031082d1c0d237bc54823be36fde2ff96103f9abf99266436cd07d351"} Sep 16 09:08:26.184881 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:26.184816 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx" Sep 16 09:08:26.184881 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:26.184819 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4b89bb031082d1c0d237bc54823be36fde2ff96103f9abf99266436cd07d351" Sep 16 09:08:35.099514 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.099469 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6"] Sep 16 09:08:35.100085 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.099842 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85023b3-98a0-48e5-81aa-8b3da94ec000" containerName="node" Sep 16 09:08:35.100085 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.099855 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85023b3-98a0-48e5-81aa-8b3da94ec000" containerName="node" Sep 16 09:08:35.100085 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.099941 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85023b3-98a0-48e5-81aa-8b3da94ec000" containerName="node" Sep 16 09:08:35.102216 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.102194 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" Sep 16 09:08:35.104809 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.104780 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-stbvh\"/\"openshift-service-ca.crt\"" Sep 16 09:08:35.104995 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.104874 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-stbvh\"/\"default-dockercfg-78k5q\"" Sep 16 09:08:35.104995 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.104957 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-stbvh\"/\"kube-root-ca.crt\"" Sep 16 09:08:35.115921 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.115881 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6"] Sep 16 09:08:35.243711 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.243673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc2rj\" (UniqueName: \"kubernetes.io/projected/edeb4e8a-3793-4f1d-bb0d-5bd359abdebf-kube-api-access-wc2rj\") pod \"progression-invalid-node-0-0-nccf6\" (UID: \"edeb4e8a-3793-4f1d-bb0d-5bd359abdebf\") " pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" Sep 16 09:08:35.344754 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.344709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc2rj\" (UniqueName: \"kubernetes.io/projected/edeb4e8a-3793-4f1d-bb0d-5bd359abdebf-kube-api-access-wc2rj\") pod \"progression-invalid-node-0-0-nccf6\" (UID: \"edeb4e8a-3793-4f1d-bb0d-5bd359abdebf\") " pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" Sep 16 09:08:35.354314 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.354239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc2rj\" (UniqueName: \"kubernetes.io/projected/edeb4e8a-3793-4f1d-bb0d-5bd359abdebf-kube-api-access-wc2rj\") pod \"progression-invalid-node-0-0-nccf6\" (UID: \"edeb4e8a-3793-4f1d-bb0d-5bd359abdebf\") " pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" Sep 16 09:08:35.412686 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.412647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" Sep 16 09:08:35.687290 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:35.687265 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6"] Sep 16 09:08:35.689442 ip-10-0-141-124 kubenswrapper[2564]: W0916 09:08:35.689415 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedeb4e8a_3793_4f1d_bb0d_5bd359abdebf.slice/crio-6f40669eae8dcd3916f2137c13ce604f068bd62f90432d48bd0a6d24425e74f7 WatchSource:0}: Error finding container 6f40669eae8dcd3916f2137c13ce604f068bd62f90432d48bd0a6d24425e74f7: Status 404 returned error can't find the container with id 6f40669eae8dcd3916f2137c13ce604f068bd62f90432d48bd0a6d24425e74f7 Sep 16 09:08:36.234038 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:36.233990 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" event={"ID":"edeb4e8a-3793-4f1d-bb0d-5bd359abdebf","Type":"ContainerStarted","Data":"9f648b7ed016f815c1dfb50c8b48e3dde99a01da5da18fd2d0bcee6c1e1ba123"} Sep 16 09:08:36.234435 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:36.234051 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" event={"ID":"edeb4e8a-3793-4f1d-bb0d-5bd359abdebf","Type":"ContainerStarted","Data":"6f40669eae8dcd3916f2137c13ce604f068bd62f90432d48bd0a6d24425e74f7"} Sep 16 09:08:36.234435 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:36.234088 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" Sep 16 09:08:36.252464 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:36.252398 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" podStartSLOduration=1.2523742150000001 podStartE2EDuration="1.252374215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 09:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 09:08:36.251421192 +0000 UTC m=+672.839182787" watchObservedRunningTime="2026-09-16 09:08:36.252374215 +0000 UTC m=+672.840135809" Sep 16 09:08:37.237123 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:37.237081 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" podUID="edeb4e8a-3793-4f1d-bb0d-5bd359abdebf" containerName="node" probeResult="failure" output="Get \"http://10.134.0.30:28080/metrics\": dial tcp 10.134.0.30:28080: connect: connection refused" Sep 16 09:08:37.241036 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:37.241001 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" podUID="edeb4e8a-3793-4f1d-bb0d-5bd359abdebf" containerName="node" probeResult="failure" output="Get \"http://10.134.0.30:28080/metrics\": dial tcp 10.134.0.30:28080: connect: connection refused" Sep 16 09:08:38.242918 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:38.242887 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" Sep 16 09:08:59.241319 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:59.241207 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" podUID="edeb4e8a-3793-4f1d-bb0d-5bd359abdebf" containerName="node" probeResult="failure" output="Get \"http://10.134.0.30:28080/metrics\": dial tcp 10.134.0.30:28080: connect: connection refused" Sep 16 09:08:59.351205 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:59.351172 2564 generic.go:356] "Generic (PLEG): container finished" podID="edeb4e8a-3793-4f1d-bb0d-5bd359abdebf" containerID="9f648b7ed016f815c1dfb50c8b48e3dde99a01da5da18fd2d0bcee6c1e1ba123" exitCode=0 Sep 16 09:08:59.351381 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:08:59.351234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" event={"ID":"edeb4e8a-3793-4f1d-bb0d-5bd359abdebf","Type":"ContainerDied","Data":"9f648b7ed016f815c1dfb50c8b48e3dde99a01da5da18fd2d0bcee6c1e1ba123"} Sep 16 09:09:00.492475 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:09:00.492449 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" Sep 16 09:09:00.571346 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:09:00.571311 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc2rj\" (UniqueName: \"kubernetes.io/projected/edeb4e8a-3793-4f1d-bb0d-5bd359abdebf-kube-api-access-wc2rj\") pod \"edeb4e8a-3793-4f1d-bb0d-5bd359abdebf\" (UID: \"edeb4e8a-3793-4f1d-bb0d-5bd359abdebf\") " Sep 16 09:09:00.573400 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:09:00.573373 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edeb4e8a-3793-4f1d-bb0d-5bd359abdebf-kube-api-access-wc2rj" (OuterVolumeSpecName: "kube-api-access-wc2rj") pod "edeb4e8a-3793-4f1d-bb0d-5bd359abdebf" (UID: "edeb4e8a-3793-4f1d-bb0d-5bd359abdebf"). InnerVolumeSpecName "kube-api-access-wc2rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 09:09:00.672653 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:09:00.672609 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc2rj\" (UniqueName: \"kubernetes.io/projected/edeb4e8a-3793-4f1d-bb0d-5bd359abdebf-kube-api-access-wc2rj\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:09:01.361166 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:09:01.361134 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" Sep 16 09:09:01.361341 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:09:01.361140 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6" event={"ID":"edeb4e8a-3793-4f1d-bb0d-5bd359abdebf","Type":"ContainerDied","Data":"6f40669eae8dcd3916f2137c13ce604f068bd62f90432d48bd0a6d24425e74f7"} Sep 16 09:09:01.361341 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:09:01.361254 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f40669eae8dcd3916f2137c13ce604f068bd62f90432d48bd0a6d24425e74f7" Sep 16 09:10:48.773808 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.773713 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s"] Sep 16 09:10:48.774404 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.774249 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edeb4e8a-3793-4f1d-bb0d-5bd359abdebf" containerName="node" Sep 16 09:10:48.774404 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.774279 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="edeb4e8a-3793-4f1d-bb0d-5bd359abdebf" containerName="node" Sep 16 09:10:48.774404 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.774376 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="edeb4e8a-3793-4f1d-bb0d-5bd359abdebf" containerName="node" Sep 16 09:10:48.776471 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.776450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" Sep 16 09:10:48.779070 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.779048 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-stbvh\"/\"kube-root-ca.crt\"" Sep 16 09:10:48.779197 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.779139 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-stbvh\"/\"openshift-service-ca.crt\"" Sep 16 09:10:48.779266 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.779215 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-stbvh\"/\"default-dockercfg-78k5q\"" Sep 16 09:10:48.784713 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.784684 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s"] Sep 16 09:10:48.920344 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:48.920306 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hs8c\" (UniqueName: \"kubernetes.io/projected/00b6ee9c-c244-4bef-acf2-58c2224b614f-kube-api-access-5hs8c\") pod \"progression-no-metrics-node-0-0-j285s\" (UID: \"00b6ee9c-c244-4bef-acf2-58c2224b614f\") " pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" Sep 16 09:10:49.021187 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:49.021150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hs8c\" (UniqueName: \"kubernetes.io/projected/00b6ee9c-c244-4bef-acf2-58c2224b614f-kube-api-access-5hs8c\") pod \"progression-no-metrics-node-0-0-j285s\" (UID: \"00b6ee9c-c244-4bef-acf2-58c2224b614f\") " pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" Sep 16 09:10:49.030982 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:49.030927 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hs8c\" (UniqueName: \"kubernetes.io/projected/00b6ee9c-c244-4bef-acf2-58c2224b614f-kube-api-access-5hs8c\") pod \"progression-no-metrics-node-0-0-j285s\" (UID: \"00b6ee9c-c244-4bef-acf2-58c2224b614f\") " pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" Sep 16 09:10:49.086625 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:49.086599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" Sep 16 09:10:49.355243 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:49.355214 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s"] Sep 16 09:10:49.358174 ip-10-0-141-124 kubenswrapper[2564]: W0916 09:10:49.358144 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b6ee9c_c244_4bef_acf2_58c2224b614f.slice/crio-a3f85aef35883ad39317afed3bf66563941523041cc7f21e8efc84534f74ecfb WatchSource:0}: Error finding container a3f85aef35883ad39317afed3bf66563941523041cc7f21e8efc84534f74ecfb: Status 404 returned error can't find the container with id a3f85aef35883ad39317afed3bf66563941523041cc7f21e8efc84534f74ecfb Sep 16 09:10:49.878265 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:49.878226 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" event={"ID":"00b6ee9c-c244-4bef-acf2-58c2224b614f","Type":"ContainerStarted","Data":"71f378b30973aca9b9727692f02a54b1886606296ec2997b73c461dd84b85675"} Sep 16 09:10:49.878659 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:49.878309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" event={"ID":"00b6ee9c-c244-4bef-acf2-58c2224b614f","Type":"ContainerStarted","Data":"a3f85aef35883ad39317afed3bf66563941523041cc7f21e8efc84534f74ecfb"} Sep 16 09:10:49.894730 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:49.894680 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" podStartSLOduration=1.894665773 podStartE2EDuration="1.894665773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 09:10:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 09:10:49.892533322 +0000 UTC m=+806.480294916" watchObservedRunningTime="2026-09-16 09:10:49.894665773 +0000 UTC m=+806.482427367" Sep 16 09:10:54.904441 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:54.904405 2564 generic.go:356] "Generic (PLEG): container finished" podID="00b6ee9c-c244-4bef-acf2-58c2224b614f" containerID="71f378b30973aca9b9727692f02a54b1886606296ec2997b73c461dd84b85675" exitCode=0 Sep 16 09:10:54.904829 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:54.904479 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" event={"ID":"00b6ee9c-c244-4bef-acf2-58c2224b614f","Type":"ContainerDied","Data":"71f378b30973aca9b9727692f02a54b1886606296ec2997b73c461dd84b85675"} Sep 16 09:10:56.042721 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:56.042685 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" Sep 16 09:10:56.185642 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:56.185544 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hs8c\" (UniqueName: \"kubernetes.io/projected/00b6ee9c-c244-4bef-acf2-58c2224b614f-kube-api-access-5hs8c\") pod \"00b6ee9c-c244-4bef-acf2-58c2224b614f\" (UID: \"00b6ee9c-c244-4bef-acf2-58c2224b614f\") " Sep 16 09:10:56.187758 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:56.187724 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b6ee9c-c244-4bef-acf2-58c2224b614f-kube-api-access-5hs8c" (OuterVolumeSpecName: "kube-api-access-5hs8c") pod "00b6ee9c-c244-4bef-acf2-58c2224b614f" (UID: "00b6ee9c-c244-4bef-acf2-58c2224b614f"). InnerVolumeSpecName "kube-api-access-5hs8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 09:10:56.286774 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:56.286730 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hs8c\" (UniqueName: \"kubernetes.io/projected/00b6ee9c-c244-4bef-acf2-58c2224b614f-kube-api-access-5hs8c\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:10:56.915204 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:56.915174 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" Sep 16 09:10:56.915384 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:56.915174 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s" event={"ID":"00b6ee9c-c244-4bef-acf2-58c2224b614f","Type":"ContainerDied","Data":"a3f85aef35883ad39317afed3bf66563941523041cc7f21e8efc84534f74ecfb"} Sep 16 09:10:56.915384 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:56.915297 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3f85aef35883ad39317afed3bf66563941523041cc7f21e8efc84534f74ecfb" Sep 16 09:10:59.036241 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.036205 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-klx2n/must-gather-cw29p"] Sep 16 09:10:59.036632 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.036556 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b6ee9c-c244-4bef-acf2-58c2224b614f" containerName="node" Sep 16 09:10:59.036632 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.036567 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b6ee9c-c244-4bef-acf2-58c2224b614f" containerName="node" Sep 16 09:10:59.036632 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.036627 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b6ee9c-c244-4bef-acf2-58c2224b614f" containerName="node" Sep 16 09:10:59.038594 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.038575 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:10:59.041282 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.041259 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-klx2n\"/\"kube-root-ca.crt\"" Sep 16 09:10:59.041381 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.041263 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-klx2n\"/\"openshift-service-ca.crt\"" Sep 16 09:10:59.041980 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.041964 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-klx2n\"/\"default-dockercfg-f6gfk\"" Sep 16 09:10:59.046115 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.046075 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-klx2n/must-gather-cw29p"] Sep 16 09:10:59.108049 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.107995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71b44236-d053-4feb-8cb5-799f4bd0f386-must-gather-output\") pod \"must-gather-cw29p\" (UID: \"71b44236-d053-4feb-8cb5-799f4bd0f386\") " pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:10:59.108049 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.108049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k2ds\" (UniqueName: \"kubernetes.io/projected/71b44236-d053-4feb-8cb5-799f4bd0f386-kube-api-access-2k2ds\") pod \"must-gather-cw29p\" (UID: \"71b44236-d053-4feb-8cb5-799f4bd0f386\") " pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:10:59.209288 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.209228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71b44236-d053-4feb-8cb5-799f4bd0f386-must-gather-output\") pod \"must-gather-cw29p\" (UID: \"71b44236-d053-4feb-8cb5-799f4bd0f386\") " pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:10:59.209288 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.209297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k2ds\" (UniqueName: \"kubernetes.io/projected/71b44236-d053-4feb-8cb5-799f4bd0f386-kube-api-access-2k2ds\") pod \"must-gather-cw29p\" (UID: \"71b44236-d053-4feb-8cb5-799f4bd0f386\") " pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:10:59.209653 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.209630 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71b44236-d053-4feb-8cb5-799f4bd0f386-must-gather-output\") pod \"must-gather-cw29p\" (UID: \"71b44236-d053-4feb-8cb5-799f4bd0f386\") " pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:10:59.216928 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.216893 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k2ds\" (UniqueName: \"kubernetes.io/projected/71b44236-d053-4feb-8cb5-799f4bd0f386-kube-api-access-2k2ds\") pod \"must-gather-cw29p\" (UID: \"71b44236-d053-4feb-8cb5-799f4bd0f386\") " pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:10:59.349755 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.349673 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:10:59.617582 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.617401 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-klx2n/must-gather-cw29p"] Sep 16 09:10:59.620162 ip-10-0-141-124 kubenswrapper[2564]: W0916 09:10:59.620139 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71b44236_d053_4feb_8cb5_799f4bd0f386.slice/crio-b043d5195b73adbe5d0162406b38af484e78d6f2da997020dc1bc5d72f7b8ecb WatchSource:0}: Error finding container b043d5195b73adbe5d0162406b38af484e78d6f2da997020dc1bc5d72f7b8ecb: Status 404 returned error can't find the container with id b043d5195b73adbe5d0162406b38af484e78d6f2da997020dc1bc5d72f7b8ecb Sep 16 09:10:59.621976 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.621960 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 16 09:10:59.929789 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:10:59.929700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-klx2n/must-gather-cw29p" event={"ID":"71b44236-d053-4feb-8cb5-799f4bd0f386","Type":"ContainerStarted","Data":"b043d5195b73adbe5d0162406b38af484e78d6f2da997020dc1bc5d72f7b8ecb"} Sep 16 09:11:03.839589 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.839545 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx"] Sep 16 09:11:03.843802 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.843766 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-stbvh/progression-disabled-node-0-0-r6znx"] Sep 16 09:11:03.849315 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.849243 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj"] Sep 16 09:11:03.851941 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.851899 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-stbvh/progression-enabled-node-0-0-9kmxj"] Sep 16 09:11:03.856878 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.856833 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6"] Sep 16 09:11:03.860909 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.860857 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-stbvh/progression-invalid-node-0-0-nccf6"] Sep 16 09:11:03.878353 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.878315 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s"] Sep 16 09:11:03.884722 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.884691 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-stbvh/progression-no-metrics-node-0-0-j285s"] Sep 16 09:11:03.917537 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.917506 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b6ee9c-c244-4bef-acf2-58c2224b614f" path="/var/lib/kubelet/pods/00b6ee9c-c244-4bef-acf2-58c2224b614f/volumes" Sep 16 09:11:03.917890 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.917856 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06b5c652-7e53-4ee2-a517-3a21a6ff0c07" path="/var/lib/kubelet/pods/06b5c652-7e53-4ee2-a517-3a21a6ff0c07/volumes" Sep 16 09:11:03.918188 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.918175 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d85023b3-98a0-48e5-81aa-8b3da94ec000" path="/var/lib/kubelet/pods/d85023b3-98a0-48e5-81aa-8b3da94ec000/volumes" Sep 16 09:11:03.918482 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:03.918470 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edeb4e8a-3793-4f1d-bb0d-5bd359abdebf" path="/var/lib/kubelet/pods/edeb4e8a-3793-4f1d-bb0d-5bd359abdebf/volumes" Sep 16 09:11:06.975922 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:06.975883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-klx2n/must-gather-cw29p" event={"ID":"71b44236-d053-4feb-8cb5-799f4bd0f386","Type":"ContainerStarted","Data":"4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712"} Sep 16 09:11:06.975922 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:06.975929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-klx2n/must-gather-cw29p" event={"ID":"71b44236-d053-4feb-8cb5-799f4bd0f386","Type":"ContainerStarted","Data":"e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14"} Sep 16 09:11:06.990479 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:06.990411 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-klx2n/must-gather-cw29p" podStartSLOduration=1.7089317240000002 podStartE2EDuration="7.990388533s" totalImagesPullingTime="6.281456809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 09:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 09:11:06.990348603 +0000 UTC m=+823.578110197" watchObservedRunningTime="2026-09-16 09:11:06.990388533 +0000 UTC m=+823.578150130" Sep 16 09:11:51.226513 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:51.226475 2564 generic.go:356] "Generic (PLEG): container finished" podID="71b44236-d053-4feb-8cb5-799f4bd0f386" containerID="e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14" exitCode=0 Sep 16 09:11:51.226946 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:51.226522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-klx2n/must-gather-cw29p" event={"ID":"71b44236-d053-4feb-8cb5-799f4bd0f386","Type":"ContainerDied","Data":"e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14"} Sep 16 09:11:51.226946 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:51.226827 2564 scope.go:117] "RemoveContainer" containerID="e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14" Sep 16 09:11:51.554767 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:51.554682 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-klx2n_must-gather-cw29p_71b44236-d053-4feb-8cb5-799f4bd0f386/gather/0.log" Sep 16 09:11:54.579449 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:54.579419 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5pfmn_cc8d5aba-2ac1-4322-8953-92b305aedbe4/global-pull-secret-syncer/0.log" Sep 16 09:11:54.732463 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:54.732427 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9bl8v_11c8e918-ff0a-4fe2-9446-6dd3fd3a6af6/konnectivity-agent/0.log" Sep 16 09:11:54.821392 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:54.821362 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-124.ec2.internal_e504b6ddcb0faa30a582965ff580b686/haproxy/0.log" Sep 16 09:11:56.871759 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:56.871720 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-klx2n/must-gather-cw29p"] Sep 16 09:11:56.872282 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:56.871908 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-klx2n/must-gather-cw29p" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" containerName="copy" containerID="cri-o://4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712" gracePeriod=2 Sep 16 09:11:56.878351 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:56.878328 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-klx2n/must-gather-cw29p"] Sep 16 09:11:56.878893 ip-10-0-141-124 kubenswrapper[2564]: E0916 09:11:56.878844 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"71b44236-d053-4feb-8cb5-799f4bd0f386\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-klx2n\"/\"must-gather-cw29p\": pods \"must-gather-cw29p\" not found" pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:11:57.106948 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.106923 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-klx2n_must-gather-cw29p_71b44236-d053-4feb-8cb5-799f4bd0f386/copy/0.log" Sep 16 09:11:57.109505 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.109484 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:11:57.111624 ip-10-0-141-124 kubenswrapper[2564]: E0916 09:11:57.111597 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-cw29p\" is forbidden: User \"system:node:ip-10-0-141-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-klx2n\": no relationship found between node 'ip-10-0-141-124.ec2.internal' and this object" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:11:57.166093 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.166025 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k2ds\" (UniqueName: \"kubernetes.io/projected/71b44236-d053-4feb-8cb5-799f4bd0f386-kube-api-access-2k2ds\") pod \"71b44236-d053-4feb-8cb5-799f4bd0f386\" (UID: \"71b44236-d053-4feb-8cb5-799f4bd0f386\") " Sep 16 09:11:57.166093 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.166090 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71b44236-d053-4feb-8cb5-799f4bd0f386-must-gather-output\") pod \"71b44236-d053-4feb-8cb5-799f4bd0f386\" (UID: \"71b44236-d053-4feb-8cb5-799f4bd0f386\") " Sep 16 09:11:57.167164 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.167136 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b44236-d053-4feb-8cb5-799f4bd0f386-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "71b44236-d053-4feb-8cb5-799f4bd0f386" (UID: "71b44236-d053-4feb-8cb5-799f4bd0f386"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 16 09:11:57.168258 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.168223 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b44236-d053-4feb-8cb5-799f4bd0f386-kube-api-access-2k2ds" (OuterVolumeSpecName: "kube-api-access-2k2ds") pod "71b44236-d053-4feb-8cb5-799f4bd0f386" (UID: "71b44236-d053-4feb-8cb5-799f4bd0f386"). InnerVolumeSpecName "kube-api-access-2k2ds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 16 09:11:57.259658 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.259629 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-klx2n_must-gather-cw29p_71b44236-d053-4feb-8cb5-799f4bd0f386/copy/0.log" Sep 16 09:11:57.260049 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.260027 2564 generic.go:356] "Generic (PLEG): container finished" podID="71b44236-d053-4feb-8cb5-799f4bd0f386" containerID="4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712" exitCode=143 Sep 16 09:11:57.260126 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.260078 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:11:57.260126 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.260114 2564 scope.go:117] "RemoveContainer" containerID="4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712" Sep 16 09:11:57.262509 ip-10-0-141-124 kubenswrapper[2564]: E0916 09:11:57.262478 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-cw29p\" is forbidden: User \"system:node:ip-10-0-141-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-klx2n\": no relationship found between node 'ip-10-0-141-124.ec2.internal' and this object" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:11:57.267779 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.267485 2564 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/71b44236-d053-4feb-8cb5-799f4bd0f386-must-gather-output\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:11:57.267779 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.267505 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k2ds\" (UniqueName: \"kubernetes.io/projected/71b44236-d053-4feb-8cb5-799f4bd0f386-kube-api-access-2k2ds\") on node \"ip-10-0-141-124.ec2.internal\" DevicePath \"\"" Sep 16 09:11:57.268325 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.268309 2564 scope.go:117] "RemoveContainer" containerID="e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14" Sep 16 09:11:57.270055 ip-10-0-141-124 kubenswrapper[2564]: E0916 09:11:57.270018 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-cw29p\" is forbidden: User \"system:node:ip-10-0-141-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-klx2n\": no relationship found between node 'ip-10-0-141-124.ec2.internal' and this object" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" pod="openshift-must-gather-klx2n/must-gather-cw29p" Sep 16 09:11:57.280747 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.280732 2564 scope.go:117] "RemoveContainer" containerID="4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712" Sep 16 09:11:57.281046 ip-10-0-141-124 kubenswrapper[2564]: E0916 09:11:57.281027 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712\": container with ID starting with 4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712 not found: ID does not exist" containerID="4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712" Sep 16 09:11:57.281102 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.281058 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712"} err="failed to get container status \"4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712\": rpc error: code = NotFound desc = could not find container \"4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712\": container with ID starting with 4273ce3c53d23a21f7913435d6a3b139df2f0afe57a41d47fcb225f09ab1c712 not found: ID does not exist" Sep 16 09:11:57.281102 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.281077 2564 scope.go:117] "RemoveContainer" containerID="e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14" Sep 16 09:11:57.281338 ip-10-0-141-124 kubenswrapper[2564]: E0916 09:11:57.281320 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14\": container with ID starting with e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14 not found: ID does not exist" containerID="e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14" Sep 16 09:11:57.281390 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.281347 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14"} err="failed to get container status \"e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14\": rpc error: code = NotFound desc = could not find container \"e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14\": container with ID starting with e4e2cbec64096dd6b806b41debe3085e133a50cc724747c3355a95d9f8abcc14 not found: ID does not exist" Sep 16 09:11:57.916458 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:57.916426 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" path="/var/lib/kubelet/pods/71b44236-d053-4feb-8cb5-799f4bd0f386/volumes" Sep 16 09:11:58.272306 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.272230 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6540db-3836-4b6a-93b0-662fdf423aa3/alertmanager/0.log" Sep 16 09:11:58.315081 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.315056 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6540db-3836-4b6a-93b0-662fdf423aa3/config-reloader/0.log" Sep 16 09:11:58.351773 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.351751 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6540db-3836-4b6a-93b0-662fdf423aa3/kube-rbac-proxy-web/0.log" Sep 16 09:11:58.396032 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.396001 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6540db-3836-4b6a-93b0-662fdf423aa3/kube-rbac-proxy/0.log" Sep 16 09:11:58.441996 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.441961 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6540db-3836-4b6a-93b0-662fdf423aa3/kube-rbac-proxy-metric/0.log" Sep 16 09:11:58.474595 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.474575 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6540db-3836-4b6a-93b0-662fdf423aa3/prom-label-proxy/0.log" Sep 16 09:11:58.504662 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.504639 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d6540db-3836-4b6a-93b0-662fdf423aa3/init-config-reloader/0.log" Sep 16 09:11:58.566988 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.566919 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-gnrmn_36b530db-d017-477d-bd7a-86a518bbc12a/kube-state-metrics/0.log" Sep 16 09:11:58.594900 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.594877 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-gnrmn_36b530db-d017-477d-bd7a-86a518bbc12a/kube-rbac-proxy-main/0.log" Sep 16 09:11:58.620682 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.620657 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-gnrmn_36b530db-d017-477d-bd7a-86a518bbc12a/kube-rbac-proxy-self/0.log" Sep 16 09:11:58.647209 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.647172 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-dd77fcd56-jnj4n_18a898d7-0aa6-436c-a1af-5ed6cc468460/metrics-server/0.log" Sep 16 09:11:58.683076 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.683052 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-4qcfv_fe9017de-ea59-4fa9-ac36-f9c2a6507ffc/monitoring-plugin/0.log" Sep 16 09:11:58.793080 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.793055 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64q69_f069bb5c-c422-4ee8-8967-9d3d947a5cbb/node-exporter/0.log" Sep 16 09:11:58.834560 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.834489 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64q69_f069bb5c-c422-4ee8-8967-9d3d947a5cbb/kube-rbac-proxy/0.log" Sep 16 09:11:58.866446 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.866423 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-64q69_f069bb5c-c422-4ee8-8967-9d3d947a5cbb/init-textfile/0.log" Sep 16 09:11:58.974300 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:58.974276 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-dwzbz_3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40/kube-rbac-proxy-main/0.log" Sep 16 09:11:59.004720 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.004697 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-dwzbz_3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40/kube-rbac-proxy-self/0.log" Sep 16 09:11:59.034857 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.034821 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-dwzbz_3d66e7f5-d66c-4cc8-8cc3-4628f9c57c40/openshift-state-metrics/0.log" Sep 16 09:11:59.073296 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.073270 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0ec9455-ea82-4a0f-abb2-fd1d1af156ea/prometheus/0.log" Sep 16 09:11:59.093975 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.093902 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0ec9455-ea82-4a0f-abb2-fd1d1af156ea/config-reloader/0.log" Sep 16 09:11:59.113197 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.113175 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0ec9455-ea82-4a0f-abb2-fd1d1af156ea/thanos-sidecar/0.log" Sep 16 09:11:59.134932 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.134914 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0ec9455-ea82-4a0f-abb2-fd1d1af156ea/kube-rbac-proxy-web/0.log" Sep 16 09:11:59.154649 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.154626 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0ec9455-ea82-4a0f-abb2-fd1d1af156ea/kube-rbac-proxy/0.log" Sep 16 09:11:59.178207 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.178186 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0ec9455-ea82-4a0f-abb2-fd1d1af156ea/kube-rbac-proxy-thanos/0.log" Sep 16 09:11:59.197159 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.197139 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0ec9455-ea82-4a0f-abb2-fd1d1af156ea/init-config-reloader/0.log" Sep 16 09:11:59.224527 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.224495 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-898qg_8b5d785e-d342-433b-94c7-29503c9c9a95/prometheus-operator/0.log" Sep 16 09:11:59.243941 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.243922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-898qg_8b5d785e-d342-433b-94c7-29503c9c9a95/kube-rbac-proxy/0.log" Sep 16 09:11:59.265220 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.265196 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-vsrk9_8805bcef-2383-4829-8a97-8cbad8aa3e06/prometheus-operator-admission-webhook/0.log" Sep 16 09:11:59.364660 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.364588 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d46dfc4df-kzwtb_451f5e4a-d90d-4ac1-ab0b-b7c7056146fe/thanos-query/0.log" Sep 16 09:11:59.382027 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.381999 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d46dfc4df-kzwtb_451f5e4a-d90d-4ac1-ab0b-b7c7056146fe/kube-rbac-proxy-web/0.log" Sep 16 09:11:59.408722 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.408696 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d46dfc4df-kzwtb_451f5e4a-d90d-4ac1-ab0b-b7c7056146fe/kube-rbac-proxy/0.log" Sep 16 09:11:59.434759 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.434734 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d46dfc4df-kzwtb_451f5e4a-d90d-4ac1-ab0b-b7c7056146fe/prom-label-proxy/0.log" Sep 16 09:11:59.451883 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.451841 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d46dfc4df-kzwtb_451f5e4a-d90d-4ac1-ab0b-b7c7056146fe/kube-rbac-proxy-rules/0.log" Sep 16 09:11:59.474006 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:11:59.473977 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d46dfc4df-kzwtb_451f5e4a-d90d-4ac1-ab0b-b7c7056146fe/kube-rbac-proxy-metrics/0.log" Sep 16 09:12:01.548186 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:01.548156 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84c89968cd-mkgdz_1415d6c8-d242-490e-9552-167d3aff1766/console/0.log" Sep 16 09:12:01.575134 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:01.575110 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-4c4b4_05a40bab-9902-4913-8310-2d5ed4271fdd/download-server/0.log" Sep 16 09:12:02.425450 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.425418 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm"] Sep 16 09:12:02.425800 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.425787 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" containerName="copy" Sep 16 09:12:02.425849 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.425801 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" containerName="copy" Sep 16 09:12:02.425849 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.425818 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" containerName="gather" Sep 16 09:12:02.425849 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.425824 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" containerName="gather" Sep 16 09:12:02.425961 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.425892 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" containerName="copy" Sep 16 09:12:02.425961 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.425901 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="71b44236-d053-4feb-8cb5-799f4bd0f386" containerName="gather" Sep 16 09:12:02.431118 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.431095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.433876 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.433842 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpwmz\"/\"kube-root-ca.crt\"" Sep 16 09:12:02.434896 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.434849 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bpwmz\"/\"default-dockercfg-hmrsq\"" Sep 16 09:12:02.434896 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.434855 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpwmz\"/\"openshift-service-ca.crt\"" Sep 16 09:12:02.437465 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.437440 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm"] Sep 16 09:12:02.511736 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.511697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-sys\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.512203 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.511747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nplgc\" (UniqueName: \"kubernetes.io/projected/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-kube-api-access-nplgc\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.512203 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.511771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-proc\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.512203 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.511848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-lib-modules\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.512203 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.511964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-podres\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.613039 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.613000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-podres\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.613477 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.613052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-sys\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.613477 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.613086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplgc\" (UniqueName: \"kubernetes.io/projected/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-kube-api-access-nplgc\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.613477 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.613109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-proc\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.613477 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.613129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-lib-modules\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.613477 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.613178 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-podres\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.613477 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.613213 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-proc\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.613477 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.613230 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-sys\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.613477 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.613255 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-lib-modules\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.620403 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.620370 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nplgc\" (UniqueName: \"kubernetes.io/projected/6f54f4b6-6a67-43a8-b793-13c2f1fbf506-kube-api-access-nplgc\") pod \"perf-node-gather-daemonset-r84dm\" (UID: \"6f54f4b6-6a67-43a8-b793-13c2f1fbf506\") " pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.741531 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.741446 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:02.908111 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.908081 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wvcw2_c9604391-4c7a-42d5-81d3-1ded390ab580/dns/0.log" Sep 16 09:12:02.924983 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.924955 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wvcw2_c9604391-4c7a-42d5-81d3-1ded390ab580/kube-rbac-proxy/0.log" Sep 16 09:12:02.943739 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:02.943712 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2zmb2_803c1e19-d9f2-4864-93b1-1e047384c829/dns-node-resolver/0.log" Sep 16 09:12:03.008657 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:03.008635 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm"] Sep 16 09:12:03.011068 ip-10-0-141-124 kubenswrapper[2564]: W0916 09:12:03.011043 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f54f4b6_6a67_43a8_b793_13c2f1fbf506.slice/crio-e02ffb699f446c15d22a08bcdb8a1f1ececeddd7ecee77bfc6bd7585bef8f6b7 WatchSource:0}: Error finding container e02ffb699f446c15d22a08bcdb8a1f1ececeddd7ecee77bfc6bd7585bef8f6b7: Status 404 returned error can't find the container with id e02ffb699f446c15d22a08bcdb8a1f1ececeddd7ecee77bfc6bd7585bef8f6b7 Sep 16 09:12:03.291343 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:03.291253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" event={"ID":"6f54f4b6-6a67-43a8-b793-13c2f1fbf506","Type":"ContainerStarted","Data":"fae13d9f2ac2ad5de52fa76533c489b6d190bf2d8b859842547d83c5c7749a65"} Sep 16 09:12:03.291343 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:03.291313 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" event={"ID":"6f54f4b6-6a67-43a8-b793-13c2f1fbf506","Type":"ContainerStarted","Data":"e02ffb699f446c15d22a08bcdb8a1f1ececeddd7ecee77bfc6bd7585bef8f6b7"} Sep 16 09:12:03.291537 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:03.291442 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:03.306548 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:03.306488 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" podStartSLOduration=1.30646938 podStartE2EDuration="1.30646938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 09:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 09:12:03.305199273 +0000 UTC m=+879.892960867" watchObservedRunningTime="2026-09-16 09:12:03.30646938 +0000 UTC m=+879.894231012" Sep 16 09:12:03.334255 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:03.334210 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68788df9d5-n8bpq_03c6f49b-7f7b-4a6c-b524-8629f517d8b5/registry/0.log" Sep 16 09:12:03.351050 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:03.351023 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8w9m4_883084df-acfa-46a3-8843-f8cd215214e0/node-ca/0.log" Sep 16 09:12:04.307304 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:04.307274 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mx9qq_964bb478-00a2-4671-95ef-4f9164029b79/serve-healthcheck-canary/0.log" Sep 16 09:12:04.645086 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:04.645053 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mtvjs_8bf5749e-a5dd-4611-ad9e-f7f551f3b016/kube-rbac-proxy/0.log" Sep 16 09:12:04.662388 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:04.662360 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mtvjs_8bf5749e-a5dd-4611-ad9e-f7f551f3b016/exporter/0.log" Sep 16 09:12:04.679224 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:04.679198 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mtvjs_8bf5749e-a5dd-4611-ad9e-f7f551f3b016/extractor/0.log" Sep 16 09:12:06.322063 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:06.322031 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-lmfw2_fe8ad136-a6ae-43d1-849e-ad1345803468/jobset-operator/0.log" Sep 16 09:12:09.311997 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:09.311967 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bpwmz/perf-node-gather-daemonset-r84dm" Sep 16 09:12:10.077165 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.077132 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-66rhq_107b6f39-e83e-4655-af5c-c277572fa55f/kube-multus/0.log" Sep 16 09:12:10.339418 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.339334 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq7ss_f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55/kube-multus-additional-cni-plugins/0.log" Sep 16 09:12:10.356476 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.356446 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq7ss_f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55/egress-router-binary-copy/0.log" Sep 16 09:12:10.372700 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.372673 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq7ss_f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55/cni-plugins/0.log" Sep 16 09:12:10.389121 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.389100 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq7ss_f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55/bond-cni-plugin/0.log" Sep 16 09:12:10.406136 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.406108 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq7ss_f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55/routeoverride-cni/0.log" Sep 16 09:12:10.422364 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.422343 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq7ss_f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55/whereabouts-cni-bincopy/0.log" Sep 16 09:12:10.439013 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.438988 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tq7ss_f8f04cb6-30b3-4bcf-a6c9-13a95ad2bb55/whereabouts-cni/0.log" Sep 16 09:12:10.578749 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.578717 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t4hbk_31a3ae67-af83-4267-bb9d-6d217a293b3a/network-metrics-daemon/0.log" Sep 16 09:12:10.596593 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:10.596518 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t4hbk_31a3ae67-af83-4267-bb9d-6d217a293b3a/kube-rbac-proxy/0.log" Sep 16 09:12:11.567953 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:11.567924 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtwpg_76e47c12-fba9-481a-8e21-70292e3fdb0f/ovn-controller/0.log" Sep 16 09:12:11.584066 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:11.584040 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtwpg_76e47c12-fba9-481a-8e21-70292e3fdb0f/ovn-acl-logging/0.log" Sep 16 09:12:11.610283 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:11.610252 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtwpg_76e47c12-fba9-481a-8e21-70292e3fdb0f/kube-rbac-proxy-node/0.log" Sep 16 09:12:11.625132 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:11.625101 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtwpg_76e47c12-fba9-481a-8e21-70292e3fdb0f/kube-rbac-proxy-ovn-metrics/0.log" Sep 16 09:12:11.641973 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:11.641950 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtwpg_76e47c12-fba9-481a-8e21-70292e3fdb0f/northd/0.log" Sep 16 09:12:11.660236 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:11.660204 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtwpg_76e47c12-fba9-481a-8e21-70292e3fdb0f/nbdb/0.log" Sep 16 09:12:11.680807 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:11.680773 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtwpg_76e47c12-fba9-481a-8e21-70292e3fdb0f/sbdb/0.log" Sep 16 09:12:11.714743 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:11.714707 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtwpg_76e47c12-fba9-481a-8e21-70292e3fdb0f/ovnkube-controller/0.log" Sep 16 09:12:12.805214 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:12.805136 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-j6g7d_eb92dc39-94de-4878-8934-3ba5387f3c55/network-check-target-container/0.log" Sep 16 09:12:13.657199 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:13.657174 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-tgv55_57399f85-9788-4044-8270-57e68e999572/iptables-alerter/0.log" Sep 16 09:12:14.310677 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:14.310647 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dfn6d_097b0e13-7583-48c7-a62b-0e3babca0d4d/tuned/0.log" Sep 16 09:12:17.395356 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:17.395276 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-cv529_315954c2-e444-46f9-bd36-2ff1648805c8/csi-driver/0.log" Sep 16 09:12:17.412607 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:17.412574 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-cv529_315954c2-e444-46f9-bd36-2ff1648805c8/csi-node-driver-registrar/0.log" Sep 16 09:12:17.429611 ip-10-0-141-124 kubenswrapper[2564]: I0916 09:12:17.429577 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-cv529_315954c2-e444-46f9-bd36-2ff1648805c8/csi-liveness-probe/0.log"