Sep 09 09:42:53.983248 ip-10-0-135-209 systemd[1]: Starting Kubernetes Kubelet... Sep 09 09:42:54.429989 ip-10-0-135-209 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 09:42:54.429989 ip-10-0-135-209 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 09:42:54.429989 ip-10-0-135-209 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 09:42:54.429989 ip-10-0-135-209 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 09:42:54.429989 ip-10-0-135-209 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 09:42:54.432133 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.432042 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 09:42:54.437213 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437197 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:54.437213 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437213 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437217 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437220 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437223 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437227 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437230 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437233 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437236 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437239 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437242 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437245 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437247 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437250 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437252 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437255 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437265 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437268 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437271 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437273 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437275 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:54.437279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437278 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437281 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437284 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437286 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437289 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437292 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437294 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437297 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437299 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437302 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437304 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437307 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437309 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437311 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437314 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437316 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437319 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437324 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437327 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:54.437751 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437329 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437332 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437334 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437337 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437339 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437341 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437344 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437347 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437349 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437352 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437354 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437357 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437359 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437361 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437367 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437371 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437375 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437378 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437381 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437384 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:54.438261 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437387 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437390 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437392 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437395 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437397 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437400 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437402 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437405 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437407 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437409 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437412 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437415 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437417 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437419 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437422 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437425 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437427 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437430 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437433 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437437 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:54.438758 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437440 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437443 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437445 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437448 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437450 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437453 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437457 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437461 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437464 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437467 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437470 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437473 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437476 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437478 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437481 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437484 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437487 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437490 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.437492 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438278 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:54.439279 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438291 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438295 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438299 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438302 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438305 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438308 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438310 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438314 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438317 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438320 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438322 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438325 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438327 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438330 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438332 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438335 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438338 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438341 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438343 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438346 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:54.439789 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438349 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438351 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438353 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438356 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438358 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438361 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438363 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438365 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438368 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438370 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438373 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438375 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438379 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438382 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438384 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438387 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438390 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438392 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438397 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438399 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:54.440308 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438402 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438404 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438407 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438409 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438412 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438415 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438417 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438420 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438422 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438425 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438427 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438430 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438432 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438435 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438437 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438440 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438442 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438444 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438447 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438449 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:54.440799 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438452 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438454 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438457 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438459 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438463 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438466 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438469 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438473 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438477 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438480 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438483 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438487 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438491 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438494 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438497 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438499 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438502 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438505 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438507 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:54.441337 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438509 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438512 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438514 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438518 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438521 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438523 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438526 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438529 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438533 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438535 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438538 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438540 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438542 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438545 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438547 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438550 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438552 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438555 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438557 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:54.441807 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438962 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438967 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438970 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438989 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438992 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438995 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.438998 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439001 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439003 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439006 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439009 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439011 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439014 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439017 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439019 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439022 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439025 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439027 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439030 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:54.442290 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439033 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439035 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439038 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439040 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439043 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439045 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439048 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439051 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439053 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439056 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439058 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439061 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439064 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439067 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439070 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439072 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439075 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439077 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439080 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439082 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:54.442797 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439085 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439087 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439090 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439092 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439095 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439097 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439100 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439102 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439104 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439107 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439109 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439112 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439114 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439117 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439119 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439122 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439124 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439130 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439133 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439137 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:54.443304 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439139 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439143 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439145 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439148 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439152 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439154 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439157 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439160 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439163 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439165 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439168 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439170 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439172 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439175 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439178 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439180 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439183 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439185 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439188 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439190 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:54.443791 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439192 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439195 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439198 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439202 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439204 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439207 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439209 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439216 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439219 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439222 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439225 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439227 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439229 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439232 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439236 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439240 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439243 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439246 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439249 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.439254 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:54.444328 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439332 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439368 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439375 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439379 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439383 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439386 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439390 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439395 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439398 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439401 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439404 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439408 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439411 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439413 2578 flags.go:64] FLAG: --cgroup-root="" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439416 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439419 2578 flags.go:64] FLAG: --client-ca-file="" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439422 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439425 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439429 2578 flags.go:64] FLAG: --cluster-domain="" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439433 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439436 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439439 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439442 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439446 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 09:42:54.444827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439449 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439452 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439455 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439458 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439461 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439464 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439467 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439470 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439475 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439478 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439481 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439483 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439487 2578 flags.go:64] FLAG: --enable-server="true" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439489 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439494 2578 flags.go:64] FLAG: --event-burst="100" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439497 2578 flags.go:64] FLAG: --event-qps="50" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439500 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439503 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439506 2578 flags.go:64] FLAG: --eviction-hard="" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439509 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439512 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439515 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439518 2578 flags.go:64] FLAG: --eviction-soft="" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439520 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439523 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 09:42:54.445427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439526 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439530 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439534 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439537 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439540 2578 flags.go:64] FLAG: --feature-gates="" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439544 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439547 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439550 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439552 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439555 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439559 2578 flags.go:64] FLAG: --help="false" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439562 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439564 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439567 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439570 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439573 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439577 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439580 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439582 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439585 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439587 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439590 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439593 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439596 2578 flags.go:64] FLAG: --kube-reserved="" Sep 09 09:42:54.446085 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439599 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439602 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439604 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439607 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439610 2578 flags.go:64] FLAG: --lock-file="" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439613 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439615 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439618 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439623 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439630 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439634 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439637 2578 flags.go:64] FLAG: --logging-format="text" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439640 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439643 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439646 2578 flags.go:64] FLAG: --manifest-url="" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439649 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439653 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439656 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439660 2578 flags.go:64] FLAG: --max-pods="110" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439663 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439666 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439669 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439672 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439674 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439677 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 09:42:54.446688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439680 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439688 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439691 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439694 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439697 2578 flags.go:64] FLAG: --pod-cidr="" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439700 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439705 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439707 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439710 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439713 2578 flags.go:64] FLAG: --port="10250" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439716 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439718 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04b47dd2e90866ddf" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439721 2578 flags.go:64] FLAG: --qos-reserved="" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439724 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439727 2578 flags.go:64] FLAG: --register-node="true" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439730 2578 flags.go:64] FLAG: --register-with-taints="" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439735 2578 flags.go:64] FLAG: --registry-burst="10" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439738 2578 flags.go:64] FLAG: --registry-qps="5" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439742 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439745 2578 flags.go:64] FLAG: --reserved-memory="" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439749 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439752 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439755 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439758 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439761 2578 flags.go:64] FLAG: --runonce="false" Sep 09 09:42:54.447326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439763 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439766 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439769 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439772 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439775 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439778 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439780 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439783 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439787 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439790 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439792 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439795 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439798 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439801 2578 flags.go:64] FLAG: --system-cgroups="" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439804 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439809 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439811 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439814 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439818 2578 flags.go:64] FLAG: --tls-min-version="" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439820 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439823 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439826 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439828 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439833 2578 flags.go:64] FLAG: --v="2" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439836 2578 flags.go:64] FLAG: --version="false" Sep 09 09:42:54.448150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439841 2578 flags.go:64] FLAG: --vmodule="" Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439850 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.439853 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440001 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440005 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440008 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440011 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440015 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440017 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440020 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440022 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440025 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440028 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440031 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440033 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440035 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440038 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440041 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440043 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440046 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:54.448760 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440049 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440051 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440054 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440056 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440059 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440061 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440064 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440066 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440068 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440071 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440075 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440078 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440081 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440084 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440087 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440089 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440092 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440094 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440097 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440099 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:54.449263 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440102 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440105 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440107 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440110 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440112 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440115 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440117 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440119 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440122 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440125 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440127 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440129 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440132 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440134 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440137 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440139 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440141 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440144 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440146 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440149 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:54.449750 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440151 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440154 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440157 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440160 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440163 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440166 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440168 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440171 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440173 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440176 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440178 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440181 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440183 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440186 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440188 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440192 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440196 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440199 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440202 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:54.450271 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440205 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440208 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440210 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440213 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440215 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440218 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440222 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440225 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440228 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440231 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440233 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440236 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440239 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440241 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440244 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440247 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440250 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440253 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440256 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440258 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:54.450739 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440261 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440263 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.440266 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.440950 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.448760 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.448775 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.449685 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.449693 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449755 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449761 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449764 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449768 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449771 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449773 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:54.451282 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449777 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449779 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449782 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449784 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449787 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449790 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449792 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449795 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449797 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449800 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449802 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449805 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449808 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449810 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449813 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449815 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449818 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449820 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449823 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449825 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:54.451626 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449828 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449831 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449834 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449837 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449840 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449843 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449845 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449848 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449851 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449854 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449856 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449858 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449861 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449863 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449866 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449868 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449871 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449874 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449877 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:54.452206 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449881 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449884 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449886 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449889 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449891 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449893 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449896 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449898 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449901 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449905 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449908 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449911 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449914 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449917 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449920 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449922 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449926 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449928 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449931 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449934 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:54.452673 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449937 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449939 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449943 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449945 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449948 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449950 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449953 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449956 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449958 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449961 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449963 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449965 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449968 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449970 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449985 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449988 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449991 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449993 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449996 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.449998 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:54.453174 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450001 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450003 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450006 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450009 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450011 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450016 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450019 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450022 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450026 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450028 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450031 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450034 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450037 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450040 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:54.453658 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.450045 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450188 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450193 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450196 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450199 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450202 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450205 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450208 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450210 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450213 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450215 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450218 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450220 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450223 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450225 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450228 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450230 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450233 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450235 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450238 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 09:42:54.454023 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450240 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450242 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450245 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450247 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450251 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450255 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450258 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450262 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450264 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450267 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450271 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450274 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450277 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450280 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450283 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450286 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450289 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450292 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450294 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 09:42:54.454509 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450297 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450299 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450302 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450305 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450307 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450310 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450312 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450315 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450317 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450320 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450322 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450324 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450327 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450329 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450332 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450334 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450336 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450339 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450341 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 09:42:54.454960 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450344 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450347 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450349 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450352 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450354 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450357 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450359 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450361 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450364 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450367 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450369 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450372 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450374 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450377 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450379 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450381 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450384 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450386 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450389 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450391 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 09:42:54.455448 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450394 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450396 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450399 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450401 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450403 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450406 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450408 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450410 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450413 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450415 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450418 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450420 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450423 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450426 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450430 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450433 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450436 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450438 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450440 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450443 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 09:42:54.455923 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450445 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 09:42:54.456461 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:54.450447 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 09:42:54.456461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.450452 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 09:42:54.456461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.450553 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 09:42:54.456461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.453911 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 09:42:54.456461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.455093 2578 server.go:1019] "Starting client certificate rotation" Sep 09 09:42:54.456461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.455196 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 09:42:54.456461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.455259 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 09:42:54.459733 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.459695 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 09:42:54.461773 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.461756 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 09:42:54.473128 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.473111 2578 log.go:25] "Validated CRI v1 runtime API" Sep 09 09:42:54.476391 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.476376 2578 log.go:25] "Validated CRI v1 image API" Sep 09 09:42:54.477107 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.477091 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 09:42:54.481363 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.481331 2578 fs.go:135] Filesystem UUIDs: map[5a50a9fd-e1f9-430f-84f4-1d2d29286f8b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f95209ae-0536-4c7d-ac73-58730ba4a003:/dev/nvme0n1p3] Sep 09 09:42:54.481363 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.481357 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 09:42:54.486097 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.485942 2578 manager.go:216] Machine: {Timestamp:2026-09-09 09:42:54.485443162 +0000 UTC m=+0.371938686 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124277 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec273cec93930f9cfdc965e93ccf82ea SystemUUID:ec273cec-9393-0f9c-fdc9-65e93ccf82ea BootID:7cc1e462-c3c1-4477-94c4-0a13418339a0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:44:6e:c9:75:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:44:6e:c9:75:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:f9:aa:df:fe:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 09:42:54.486097 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.486085 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 09:42:54.486221 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.486192 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 09:42:54.490060 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.490031 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 09:42:54.490219 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.490066 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-209.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 09:42:54.491196 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.491179 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 09:42:54.491685 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.491671 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 09:42:54.491721 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.491690 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 09:42:54.491721 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.491705 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 09:42:54.492579 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.492569 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 09:42:54.494502 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.494490 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 09:42:54.498126 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.498114 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 09 09:42:54.498258 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.498248 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 09:42:54.498289 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.498279 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 09 09:42:54.498319 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.498294 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 09:42:54.498319 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.498309 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 09:42:54.498319 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.498318 2578 kubelet.go:398] "Adding apiserver pod source" Sep 09 09:42:54.498417 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.498328 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 09:42:54.498799 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.498785 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 09:42:54.498837 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.498812 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 09:42:54.501282 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.501264 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 09:42:54.504396 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.504383 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 09:42:54.504440 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.504412 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 09:42:54.505376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505365 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505384 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505390 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505396 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505405 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505410 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505424 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505429 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505436 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505441 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505456 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 09:42:54.505461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.505461 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 09:42:54.506662 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.506638 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 09:42:54.506755 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.506743 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 09:42:54.509761 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.509734 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-209.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 09:42:54.509869 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.509797 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 09:42:54.509869 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.509821 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 09:42:54.511206 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.511193 2578 server.go:1268] "Started kubelet" Sep 09 09:42:54.511317 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.511267 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 09:42:54.511360 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.511299 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 09:42:54.511404 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.511359 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 09:42:54.512049 ip-10-0-135-209 systemd[1]: Started Kubernetes Kubelet. Sep 09 09:42:54.513410 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.513396 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 09 09:42:54.515461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.515444 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 09:42:54.515554 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.515529 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 09:42:54.520614 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.520593 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 09:42:54.521389 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.521276 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 09:42:54.521651 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.521632 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:54.522227 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522208 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 09:42:54.522227 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522230 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 09:42:54.522360 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522208 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 09:42:54.522414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522364 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 09 09:42:54.522414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522372 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 09 09:42:54.522414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522386 2578 factory.go:55] Registering systemd factory Sep 09 09:42:54.522414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522401 2578 factory.go:223] Registration of the systemd container factory successfully Sep 09 09:42:54.522739 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522605 2578 factory.go:153] Registering CRI-O factory Sep 09 09:42:54.522739 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522617 2578 factory.go:223] Registration of the crio container factory successfully Sep 09 09:42:54.522739 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522677 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 09:42:54.522739 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522690 2578 factory.go:103] Registering Raw factory Sep 09 09:42:54.522739 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.522704 2578 manager.go:1196] Started watching for new ooms in manager Sep 09 09:42:54.523079 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.523067 2578 manager.go:349] Starting recovery of all containers Sep 09 09:42:54.527345 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.527315 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 09:42:54.527435 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.527414 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 09:42:54.529002 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.527526 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-209.ec2.internal.18d39dcb89bee9c0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-209.ec2.internal,UID:ip-10-0-135-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-209.ec2.internal,},FirstTimestamp:2026-09-09 09:42:54.511131072 +0000 UTC m=+0.397626600,LastTimestamp:2026-09-09 09:42:54.511131072 +0000 UTC m=+0.397626600,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-209.ec2.internal,}" Sep 09 09:42:54.535673 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.535651 2578 manager.go:354] Recovery completed Sep 09 09:42:54.541048 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.541032 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:54.542904 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.542888 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:54.542990 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.542922 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:54.542990 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.542935 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:54.543471 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.543456 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 09:42:54.543471 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.543470 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 09:42:54.543573 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.543488 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 09 09:42:54.543573 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.543498 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:54.544208 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.544194 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:54.544265 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.544223 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:54.544265 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.544236 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:54.544559 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.544545 2578 policy_none.go:49] "None policy: Start" Sep 09 09:42:54.544616 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.544566 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 09:42:54.544616 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.544580 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 09:42:54.545128 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.545048 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-209.ec2.internal.18d39dcb8ba3be9d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-209.ec2.internal,UID:ip-10-0-135-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-209.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-209.ec2.internal,},FirstTimestamp:2026-09-09 09:42:54.542904989 +0000 UTC m=+0.429400513,LastTimestamp:2026-09-09 09:42:54.542904989 +0000 UTC m=+0.429400513,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-209.ec2.internal,}" Sep 09 09:42:54.545471 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.545459 2578 policy_none.go:47] "Start" Sep 09 09:42:54.548671 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.548655 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmz8m" Sep 09 09:42:54.554380 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.554361 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmz8m" Sep 09 09:42:54.555387 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.555318 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-209.ec2.internal.18d39dcb8ba41bdb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-209.ec2.internal,UID:ip-10-0-135-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-209.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-209.ec2.internal,},FirstTimestamp:2026-09-09 09:42:54.542928859 +0000 UTC m=+0.429424383,LastTimestamp:2026-09-09 09:42:54.542928859 +0000 UTC m=+0.429424383,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-209.ec2.internal,}" Sep 09 09:42:54.586734 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.586716 2578 manager.go:337] "Starting Device Plugin manager" Sep 09 09:42:54.592900 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.586765 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 09:42:54.592900 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.586780 2578 server.go:87] "Starting device plugin registration server" Sep 09 09:42:54.592900 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.587192 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 09:42:54.592900 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.587206 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 09:42:54.592900 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.587298 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 09:42:54.592900 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.587361 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 09:42:54.592900 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.587368 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 09:42:54.592900 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.587878 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 09:42:54.592900 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.587925 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:54.596414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.596280 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 09:42:54.597781 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.597761 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 09:42:54.597856 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.597822 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 09:42:54.597856 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.597847 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 09:42:54.597957 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.597893 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 09:42:54.600023 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.600007 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:42:54.688292 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.688196 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:54.689189 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.689172 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:54.689293 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.689205 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:54.689293 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.689218 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:54.689293 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.689243 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.698432 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.698409 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.698432 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.698434 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-209.ec2.internal\": node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:54.698585 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.698515 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal"] Sep 09 09:42:54.698637 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.698594 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:54.700130 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.700109 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:54.700221 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.700146 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:54.700221 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.700164 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:54.701244 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.701232 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:54.701362 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.701349 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.701406 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.701377 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:54.701992 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.701962 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:54.702073 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.701963 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:54.702073 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.702006 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:54.702073 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.702016 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:54.702073 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.702026 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:54.702073 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.702038 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:54.703047 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.703034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.703109 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.703057 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:54.703648 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.703633 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:54.703728 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.703657 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:54.703728 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.703666 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:54.728230 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.728206 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:54.735724 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.735703 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-209.ec2.internal\" not found" node="ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.740170 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.740155 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-209.ec2.internal\" not found" node="ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.824352 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.824321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5dc4e778e86e846cbf55e64db17a6792-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"5dc4e778e86e846cbf55e64db17a6792\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.824352 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.824355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dc4e778e86e846cbf55e64db17a6792-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"5dc4e778e86e846cbf55e64db17a6792\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.824553 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.824374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd219ac27246030f2e9ce6036a40244e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-209.ec2.internal\" (UID: \"bd219ac27246030f2e9ce6036a40244e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.828426 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.828406 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:54.924854 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.924819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5dc4e778e86e846cbf55e64db17a6792-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"5dc4e778e86e846cbf55e64db17a6792\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.924854 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.924856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dc4e778e86e846cbf55e64db17a6792-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"5dc4e778e86e846cbf55e64db17a6792\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.925006 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.924875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd219ac27246030f2e9ce6036a40244e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-209.ec2.internal\" (UID: \"bd219ac27246030f2e9ce6036a40244e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.925006 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.924919 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5dc4e778e86e846cbf55e64db17a6792-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"5dc4e778e86e846cbf55e64db17a6792\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.925006 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.924932 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bd219ac27246030f2e9ce6036a40244e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-209.ec2.internal\" (UID: \"bd219ac27246030f2e9ce6036a40244e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.925006 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:54.924933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dc4e778e86e846cbf55e64db17a6792-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"5dc4e778e86e846cbf55e64db17a6792\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Sep 09 09:42:54.928897 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:54.928880 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:55.029670 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:55.029605 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:55.039770 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.039748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Sep 09 09:42:55.044088 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.043860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Sep 09 09:42:55.130513 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:55.130475 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:55.230991 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:55.230948 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:55.331601 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:55.331524 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:55.432053 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:55.432013 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:55.455199 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.455171 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 09:42:55.455342 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.455325 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 09:42:55.532370 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:55.532342 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:55.556539 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.556500 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 09:37:55 +0000 UTC" deadline="2028-06-25 19:20:36.454804086 +0000 UTC" Sep 09 09:42:55.556539 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.556533 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15729h37m40.898274873s" Sep 09 09:42:55.591865 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.591807 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 09:42:55.593084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.593066 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Sep 09 09:42:55.593186 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.593097 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 09:42:55.593186 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.593108 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Sep 09 09:42:55.633315 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:55.633286 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Sep 09 09:42:55.644236 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:55.644207 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd219ac27246030f2e9ce6036a40244e.slice/crio-07280c283354a52f277fb639a3bdfd9c16955718431b09e2dbc5a1be8d1c82db WatchSource:0}: Error finding container 07280c283354a52f277fb639a3bdfd9c16955718431b09e2dbc5a1be8d1c82db: Status 404 returned error can't find the container with id 07280c283354a52f277fb639a3bdfd9c16955718431b09e2dbc5a1be8d1c82db Sep 09 09:42:55.645082 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:55.645063 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc4e778e86e846cbf55e64db17a6792.slice/crio-aba6ea50ec5fdb5de708a88b71377a0816646753a92d85d14262abd3ece749e9 WatchSource:0}: Error finding container aba6ea50ec5fdb5de708a88b71377a0816646753a92d85d14262abd3ece749e9: Status 404 returned error can't find the container with id aba6ea50ec5fdb5de708a88b71377a0816646753a92d85d14262abd3ece749e9 Sep 09 09:42:55.652613 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.651153 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 09:42:55.674824 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.674801 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:42:55.700097 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.700076 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:42:55.722726 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:55.722703 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Sep 09 09:42:56.961154 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:56.961131 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 09:42:56.962218 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:56.962206 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Sep 09 09:42:56.968612 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:56.968600 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 09:42:57.293967 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.293875 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:42:57.725670 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.725578 2578 apiserver.go:52] "Watching apiserver" Sep 09 09:42:57.731094 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.731069 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 09:42:57.731596 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.731571 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bzgh5","kube-system/konnectivity-agent-t6cps","kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal","openshift-dns/node-resolver-r59lh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal","openshift-multus/multus-additional-cni-plugins-79hbs","openshift-multus/network-metrics-daemon-54f24","openshift-ovn-kubernetes/ovnkube-node-r4x99","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2","openshift-cluster-node-tuning-operator/tuned-wgns5","openshift-image-registry/node-ca-lp5bd","openshift-multus/multus-9d7r2","openshift-network-diagnostics/network-check-target-695dm","openshift-network-operator/iptables-alerter-9tqgw"] Sep 09 09:42:57.734245 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.734222 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.736532 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.736379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:42:57.736735 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.736710 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 09:42:57.736936 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.736892 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 09:42:57.737052 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.737038 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d8cdb\"" Sep 09 09:42:57.737112 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.737093 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 09:42:57.738507 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.738482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:42:57.738597 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.738554 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:42:57.739295 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.739274 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 09:42:57.739392 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.739353 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 09:42:57.739548 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.739529 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hr74x\"" Sep 09 09:42:57.740868 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.740851 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:42:57.740976 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.740954 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:42:57.743372 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.743105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.745240 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.745118 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 09:42:57.745240 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.745139 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 09:42:57.745353 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.745286 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 09:42:57.745406 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.745395 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 09:42:57.745605 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.745586 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 09:42:57.745673 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.745658 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-67zfz\"" Sep 09 09:42:57.746569 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.746550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:57.746661 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.746624 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:42:57.747007 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.746992 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 09:42:57.751011 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.750991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.752880 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.752859 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.753023 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.753002 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 09:42:57.753446 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.753428 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 09:42:57.753536 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.753495 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 09:42:57.753675 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.753643 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b987r\"" Sep 09 09:42:57.753966 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.753935 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 09:42:57.754245 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.754226 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 09:42:57.754245 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.754237 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 09:42:57.755081 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.755063 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 09:42:57.755167 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.755137 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pvzc2\"" Sep 09 09:42:57.755804 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.755337 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 09:42:57.755804 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.755487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.757444 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.757425 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f5qxb\"" Sep 09 09:42:57.757960 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.757650 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 09:42:57.758217 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.757767 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 09:42:57.758309 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.758110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.759953 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.759908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-run-systemd\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760074 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.759967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/947dc36a-67e2-48d1-bc1f-673e803ecb24-ovnkube-config\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760074 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.760074 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:42:57.760074 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc5rq\" (UniqueName: \"kubernetes.io/projected/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-kube-api-access-kc5rq\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-kubelet-config\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-etc-openvswitch\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-log-socket\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/947dc36a-67e2-48d1-bc1f-673e803ecb24-ovnkube-script-lib\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-socket-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-device-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-run-ovn-kubernetes\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94844c18-18bb-41ff-84f8-0d9c5618b6ec-konnectivity-ca\") pod \"konnectivity-agent-t6cps\" (UID: \"94844c18-18bb-41ff-84f8-0d9c5618b6ec\") " pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:42:57.760318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-registration-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l65nx\" (UniqueName: \"kubernetes.io/projected/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-kube-api-access-l65nx\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-kubelet\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-var-lib-openvswitch\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-node-log\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbjgf\" (UniqueName: \"kubernetes.io/projected/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-kube-api-access-nbjgf\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-run-ovn\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/947dc36a-67e2-48d1-bc1f-673e803ecb24-env-overrides\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-system-cni-dir\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-slash\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-cni-netd\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.760859 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wllwf\" (UniqueName: \"kubernetes.io/projected/947dc36a-67e2-48d1-bc1f-673e803ecb24-kube-api-access-wllwf\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-sys-fs\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-systemd-units\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-cni-bin\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94844c18-18bb-41ff-84f8-0d9c5618b6ec-agent-certs\") pod \"konnectivity-agent-t6cps\" (UID: \"94844c18-18bb-41ff-84f8-0d9c5618b6ec\") " pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760962 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-cnibin\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.760993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-etc-selinux\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-dbus\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-run-openvswitch\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/947dc36a-67e2-48d1-bc1f-673e803ecb24-ovn-node-metrics-cert\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-run-netns\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761317 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761335 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 09:42:57.761645 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761604 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 09:42:57.762544 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761887 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wxxkq\"" Sep 09 09:42:57.762544 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.761970 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 09:42:57.762669 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.762597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.762953 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.762934 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 09:42:57.763492 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.763474 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m4rb8\"" Sep 09 09:42:57.764446 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.764405 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 09:42:57.764711 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.764692 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 09:42:57.764775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.764726 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7rkgd\"" Sep 09 09:42:57.766103 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.766084 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 09:42:57.781477 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.781433 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xpffq" Sep 09 09:42:57.789746 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.789723 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xpffq" Sep 09 09:42:57.829377 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.829320 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" event={"ID":"bd219ac27246030f2e9ce6036a40244e","Type":"ContainerStarted","Data":"07280c283354a52f277fb639a3bdfd9c16955718431b09e2dbc5a1be8d1c82db"} Sep 09 09:42:57.831760 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.831734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" event={"ID":"5dc4e778e86e846cbf55e64db17a6792","Type":"ContainerStarted","Data":"aba6ea50ec5fdb5de708a88b71377a0816646753a92d85d14262abd3ece749e9"} Sep 09 09:42:57.849557 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.849526 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 09:42:57.862165 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frrzp\" (UniqueName: \"kubernetes.io/projected/14150818-ac39-4899-b393-13604e146532-kube-api-access-frrzp\") pod \"iptables-alerter-9tqgw\" (UID: \"14150818-ac39-4899-b393-13604e146532\") " pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.862305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-run-openvswitch\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.862305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/947dc36a-67e2-48d1-bc1f-673e803ecb24-ovn-node-metrics-cert\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.862305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-modprobe-d\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.862305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-run\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.862305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862269 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-run-openvswitch\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.862305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-multus-cni-dir\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-sysctl-conf\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-run-netns\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/947dc36a-67e2-48d1-bc1f-673e803ecb24-ovnkube-config\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc5rq\" (UniqueName: \"kubernetes.io/projected/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-kube-api-access-kc5rq\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-kubelet-config\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-etc-kubernetes\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2kk2\" (UniqueName: \"kubernetes.io/projected/4c6508ea-5097-4929-a283-92337e4bab62-kube-api-access-k2kk2\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-etc-openvswitch\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/947dc36a-67e2-48d1-bc1f-673e803ecb24-ovnkube-script-lib\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-socket-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-cnibin\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.862563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862566 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-run-netns\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-run-multus-certs\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-run-ovn-kubernetes\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-registration-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l65nx\" (UniqueName: \"kubernetes.io/projected/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-kube-api-access-l65nx\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-lib-modules\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-var-lib-kubelet\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-kubelet\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-system-cni-dir\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862804 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-run-k8s-cni-cncf-io\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-run-netns\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-multus-conf-dir\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-run-ovn\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/947dc36a-67e2-48d1-bc1f-673e803ecb24-env-overrides\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-system-cni-dir\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.863137 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.863017 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-sys\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-slash\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-cni-netd\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wllwf\" (UniqueName: \"kubernetes.io/projected/947dc36a-67e2-48d1-bc1f-673e803ecb24-kube-api-access-wllwf\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.863087 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret podName:7dfb4a32-9282-4df8-b36e-0979d8ae92bf nodeName:}" failed. No retries permitted until 2026-09-09 09:42:58.363071965 +0000 UTC m=+3.023625111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret") pod "global-pull-secret-syncer-bzgh5" (UID: "7dfb4a32-9282-4df8-b36e-0979d8ae92bf") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-sys-fs\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c6508ea-5097-4929-a283-92337e4bab62-multus-daemon-config\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-cni-bin\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94844c18-18bb-41ff-84f8-0d9c5618b6ec-agent-certs\") pod \"konnectivity-agent-t6cps\" (UID: \"94844c18-18bb-41ff-84f8-0d9c5618b6ec\") " pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863337 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863361 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-run-ovn\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-dbus\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-tmp\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jh5m\" (UniqueName: \"kubernetes.io/projected/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-kube-api-access-9jh5m\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.863668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-multus-socket-dir-parent\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2ad8ffb-35c6-46ee-b453-eba47783169f-host\") pod \"node-ca-lp5bd\" (UID: \"b2ad8ffb-35c6-46ee-b453-eba47783169f\") " pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-dbus\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2ad8ffb-35c6-46ee-b453-eba47783169f-serviceca\") pod \"node-ca-lp5bd\" (UID: \"b2ad8ffb-35c6-46ee-b453-eba47783169f\") " pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863584 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-sysconfig\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-run-systemd\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863632 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/947dc36a-67e2-48d1-bc1f-673e803ecb24-ovnkube-config\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863649 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/947dc36a-67e2-48d1-bc1f-673e803ecb24-ovnkube-script-lib\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863674 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/947dc36a-67e2-48d1-bc1f-673e803ecb24-env-overrides\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863690 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-etc-openvswitch\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863725 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-cni-bin\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863734 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-system-cni-dir\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a4c2598-427a-4d10-b6be-7a7f83add348-hosts-file\") pod \"node-resolver-r59lh\" (UID: \"9a4c2598-427a-4d10-b6be-7a7f83add348\") " pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-tuned\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.864305 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-log-socket\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-device-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptmd2\" (UniqueName: \"kubernetes.io/projected/9a4c2598-427a-4d10-b6be-7a7f83add348-kube-api-access-ptmd2\") pod \"node-resolver-r59lh\" (UID: \"9a4c2598-427a-4d10-b6be-7a7f83add348\") " pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14150818-ac39-4899-b393-13604e146532-iptables-alerter-script\") pod \"iptables-alerter-9tqgw\" (UID: \"14150818-ac39-4899-b393-13604e146532\") " pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.863970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14150818-ac39-4899-b393-13604e146532-host-slash\") pod \"iptables-alerter-9tqgw\" (UID: \"14150818-ac39-4899-b393-13604e146532\") " pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864017 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-log-socket\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.864043 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864061 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-device-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864074 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.864118 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:42:58.364089387 +0000 UTC m=+3.024642523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864155 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-run-systemd\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864160 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94844c18-18bb-41ff-84f8-0d9c5618b6ec-konnectivity-ca\") pod \"konnectivity-agent-t6cps\" (UID: \"94844c18-18bb-41ff-84f8-0d9c5618b6ec\") " pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864180 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-sys-fs\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5zpl\" (UniqueName: \"kubernetes.io/projected/b2ad8ffb-35c6-46ee-b453-eba47783169f-kube-api-access-f5zpl\") pod \"node-ca-lp5bd\" (UID: \"b2ad8ffb-35c6-46ee-b453-eba47783169f\") " pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-var-lib-openvswitch\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.865022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864247 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-node-log\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbjgf\" (UniqueName: \"kubernetes.io/projected/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-kube-api-access-nbjgf\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-host\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864326 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-cni-netd\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-var-lib-cni-bin\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-node-log\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864295 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864421 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-kubelet-config\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864442 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.862945 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-kubelet\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-systemd\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-var-lib-kubelet\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a4c2598-427a-4d10-b6be-7a7f83add348-tmp-dir\") pod \"node-resolver-r59lh\" (UID: \"9a4c2598-427a-4d10-b6be-7a7f83add348\") " pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-sysctl-d\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864599 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-socket-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.865909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864608 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94844c18-18bb-41ff-84f8-0d9c5618b6ec-konnectivity-ca\") pod \"konnectivity-agent-t6cps\" (UID: \"94844c18-18bb-41ff-84f8-0d9c5618b6ec\") " pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c6508ea-5097-4929-a283-92337e4bab62-cni-binary-copy\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-run-ovn-kubernetes\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864698 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-slash\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-var-lib-cni-multus\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864778 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-systemd-units\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864833 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-registration-dir\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864831 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-var-lib-openvswitch\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-cnibin\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864909 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/947dc36a-67e2-48d1-bc1f-673e803ecb24-systemd-units\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-etc-selinux\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.864973 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-cnibin\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.865009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-kubernetes\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.865039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-hostroot\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.866808 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.865058 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-etc-selinux\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.867749 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.867726 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/947dc36a-67e2-48d1-bc1f-673e803ecb24-ovn-node-metrics-cert\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.867938 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.867896 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94844c18-18bb-41ff-84f8-0d9c5618b6ec-agent-certs\") pod \"konnectivity-agent-t6cps\" (UID: \"94844c18-18bb-41ff-84f8-0d9c5618b6ec\") " pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:42:57.873952 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.873913 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:42:57.874061 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.873956 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:42:57.874061 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.873969 2578 projected.go:196] Error preparing data for projected volume kube-api-access-whq6t for pod openshift-network-diagnostics/network-check-target-695dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:42:57.874061 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:57.874032 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t podName:082d0388-4d45-4560-9a2a-d7da02a5fc1e nodeName:}" failed. No retries permitted until 2026-09-09 09:42:58.374015267 +0000 UTC m=+3.034568421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-whq6t" (UniqueName: "kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t") pod "network-check-target-695dm" (UID: "082d0388-4d45-4560-9a2a-d7da02a5fc1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:42:57.877056 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.877022 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wllwf\" (UniqueName: \"kubernetes.io/projected/947dc36a-67e2-48d1-bc1f-673e803ecb24-kube-api-access-wllwf\") pod \"ovnkube-node-r4x99\" (UID: \"947dc36a-67e2-48d1-bc1f-673e803ecb24\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:57.877186 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.877163 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l65nx\" (UniqueName: \"kubernetes.io/projected/17f8c5be-7188-425d-8ea6-ae4ea9e58b83-kube-api-access-l65nx\") pod \"aws-ebs-csi-driver-node-9p5h2\" (UID: \"17f8c5be-7188-425d-8ea6-ae4ea9e58b83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:57.878368 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.878322 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbjgf\" (UniqueName: \"kubernetes.io/projected/fd5747a3-029a-4f4a-9290-4ae6ca6537d5-kube-api-access-nbjgf\") pod \"multus-additional-cni-plugins-79hbs\" (UID: \"fd5747a3-029a-4f4a-9290-4ae6ca6537d5\") " pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:57.878639 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.878620 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc5rq\" (UniqueName: \"kubernetes.io/projected/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-kube-api-access-kc5rq\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:42:57.966128 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-run-multus-certs\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.966128 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-lib-modules\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-var-lib-kubelet\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-system-cni-dir\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-run-k8s-cni-cncf-io\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-run-netns\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-multus-conf-dir\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966228 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-run-multus-certs\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-sys\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966260 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-system-cni-dir\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c6508ea-5097-4929-a283-92337e4bab62-multus-daemon-config\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966307 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-sys\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966315 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-lib-modules\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966333 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-var-lib-kubelet\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966322 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-run-netns\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-tmp\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.966376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966357 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-run-k8s-cni-cncf-io\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jh5m\" (UniqueName: \"kubernetes.io/projected/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-kube-api-access-9jh5m\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-multus-socket-dir-parent\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2ad8ffb-35c6-46ee-b453-eba47783169f-host\") pod \"node-ca-lp5bd\" (UID: \"b2ad8ffb-35c6-46ee-b453-eba47783169f\") " pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2ad8ffb-35c6-46ee-b453-eba47783169f-serviceca\") pod \"node-ca-lp5bd\" (UID: \"b2ad8ffb-35c6-46ee-b453-eba47783169f\") " pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-sysconfig\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966499 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-multus-socket-dir-parent\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a4c2598-427a-4d10-b6be-7a7f83add348-hosts-file\") pod \"node-resolver-r59lh\" (UID: \"9a4c2598-427a-4d10-b6be-7a7f83add348\") " pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-tuned\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptmd2\" (UniqueName: \"kubernetes.io/projected/9a4c2598-427a-4d10-b6be-7a7f83add348-kube-api-access-ptmd2\") pod \"node-resolver-r59lh\" (UID: \"9a4c2598-427a-4d10-b6be-7a7f83add348\") " pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14150818-ac39-4899-b393-13604e146532-iptables-alerter-script\") pod \"iptables-alerter-9tqgw\" (UID: \"14150818-ac39-4899-b393-13604e146532\") " pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14150818-ac39-4899-b393-13604e146532-host-slash\") pod \"iptables-alerter-9tqgw\" (UID: \"14150818-ac39-4899-b393-13604e146532\") " pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5zpl\" (UniqueName: \"kubernetes.io/projected/b2ad8ffb-35c6-46ee-b453-eba47783169f-kube-api-access-f5zpl\") pod \"node-ca-lp5bd\" (UID: \"b2ad8ffb-35c6-46ee-b453-eba47783169f\") " pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-host\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-multus-conf-dir\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-var-lib-cni-bin\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-systemd\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-var-lib-kubelet\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967155 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a4c2598-427a-4d10-b6be-7a7f83add348-tmp-dir\") pod \"node-resolver-r59lh\" (UID: \"9a4c2598-427a-4d10-b6be-7a7f83add348\") " pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-sysctl-d\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c6508ea-5097-4929-a283-92337e4bab62-cni-binary-copy\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-var-lib-cni-multus\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-kubernetes\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c6508ea-5097-4929-a283-92337e4bab62-multus-daemon-config\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966876 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-sysconfig\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-hostroot\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966935 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-hostroot\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.966964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2ad8ffb-35c6-46ee-b453-eba47783169f-serviceca\") pod \"node-ca-lp5bd\" (UID: \"b2ad8ffb-35c6-46ee-b453-eba47783169f\") " pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967027 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a4c2598-427a-4d10-b6be-7a7f83add348-hosts-file\") pod \"node-resolver-r59lh\" (UID: \"9a4c2598-427a-4d10-b6be-7a7f83add348\") " pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-sysctl-d\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967072 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14150818-ac39-4899-b393-13604e146532-host-slash\") pod \"iptables-alerter-9tqgw\" (UID: \"14150818-ac39-4899-b393-13604e146532\") " pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-kubernetes\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967105 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-var-lib-cni-multus\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frrzp\" (UniqueName: \"kubernetes.io/projected/14150818-ac39-4899-b393-13604e146532-kube-api-access-frrzp\") pod \"iptables-alerter-9tqgw\" (UID: \"14150818-ac39-4899-b393-13604e146532\") " pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967145 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-var-lib-kubelet\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-modprobe-d\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.967946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-run\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967202 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-host-var-lib-cni-bin\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-multus-cni-dir\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967243 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-run\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-sysctl-conf\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-etc-kubernetes\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967339 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-etc-kubernetes\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967352 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-host\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967381 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-sysctl-conf\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2kk2\" (UniqueName: \"kubernetes.io/projected/4c6508ea-5097-4929-a283-92337e4bab62-kube-api-access-k2kk2\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967401 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c6508ea-5097-4929-a283-92337e4bab62-cni-binary-copy\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967444 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-multus-cni-dir\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-systemd\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a4c2598-427a-4d10-b6be-7a7f83add348-tmp-dir\") pod \"node-resolver-r59lh\" (UID: \"9a4c2598-427a-4d10-b6be-7a7f83add348\") " pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-modprobe-d\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967565 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2ad8ffb-35c6-46ee-b453-eba47783169f-host\") pod \"node-ca-lp5bd\" (UID: \"b2ad8ffb-35c6-46ee-b453-eba47783169f\") " pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-cnibin\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.967701 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c6508ea-5097-4929-a283-92337e4bab62-cnibin\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:57.968567 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.968052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14150818-ac39-4899-b393-13604e146532-iptables-alerter-script\") pod \"iptables-alerter-9tqgw\" (UID: \"14150818-ac39-4899-b393-13604e146532\") " pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.969209 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.969060 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-tmp\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.969750 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.969733 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-etc-tuned\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.979715 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.979658 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jh5m\" (UniqueName: \"kubernetes.io/projected/b683f88a-91f3-4b0d-8eca-01e01b15c2e6-kube-api-access-9jh5m\") pod \"tuned-wgns5\" (UID: \"b683f88a-91f3-4b0d-8eca-01e01b15c2e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:57.979715 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.979664 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptmd2\" (UniqueName: \"kubernetes.io/projected/9a4c2598-427a-4d10-b6be-7a7f83add348-kube-api-access-ptmd2\") pod \"node-resolver-r59lh\" (UID: \"9a4c2598-427a-4d10-b6be-7a7f83add348\") " pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:57.979952 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.979907 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5zpl\" (UniqueName: \"kubernetes.io/projected/b2ad8ffb-35c6-46ee-b453-eba47783169f-kube-api-access-f5zpl\") pod \"node-ca-lp5bd\" (UID: \"b2ad8ffb-35c6-46ee-b453-eba47783169f\") " pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:57.980326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.980302 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frrzp\" (UniqueName: \"kubernetes.io/projected/14150818-ac39-4899-b393-13604e146532-kube-api-access-frrzp\") pod \"iptables-alerter-9tqgw\" (UID: \"14150818-ac39-4899-b393-13604e146532\") " pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:57.981207 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:57.981183 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2kk2\" (UniqueName: \"kubernetes.io/projected/4c6508ea-5097-4929-a283-92337e4bab62-kube-api-access-k2kk2\") pod \"multus-9d7r2\" (UID: \"4c6508ea-5097-4929-a283-92337e4bab62\") " pod="openshift-multus/multus-9d7r2" Sep 09 09:42:58.051199 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.051165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" Sep 09 09:42:58.062033 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.062011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:42:58.071845 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.071821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-79hbs" Sep 09 09:42:58.078564 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.078543 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:42:58.087071 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.087053 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r59lh" Sep 09 09:42:58.094670 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.094652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgns5" Sep 09 09:42:58.102211 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.102184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lp5bd" Sep 09 09:42:58.102307 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.102219 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 09:42:58.113843 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.113812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9d7r2" Sep 09 09:42:58.120885 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.120861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9tqgw" Sep 09 09:42:58.371263 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.371177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:58.371263 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.371258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:42:58.371456 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:58.371339 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:42:58.371456 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:58.371378 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:42:58.371456 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:58.371409 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret podName:7dfb4a32-9282-4df8-b36e-0979d8ae92bf nodeName:}" failed. No retries permitted until 2026-09-09 09:42:59.371392744 +0000 UTC m=+4.031945875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret") pod "global-pull-secret-syncer-bzgh5" (UID: "7dfb4a32-9282-4df8-b36e-0979d8ae92bf") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:42:58.371456 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:58.371432 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:42:59.371416238 +0000 UTC m=+4.031969387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:42:58.471973 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.471940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:42:58.472146 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:58.472124 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:42:58.472192 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:58.472152 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:42:58.472192 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:58.472162 2578 projected.go:196] Error preparing data for projected volume kube-api-access-whq6t for pod openshift-network-diagnostics/network-check-target-695dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:42:58.472269 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:58.472214 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t podName:082d0388-4d45-4560-9a2a-d7da02a5fc1e nodeName:}" failed. No retries permitted until 2026-09-09 09:42:59.47220159 +0000 UTC m=+4.132754724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-whq6t" (UniqueName: "kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t") pod "network-check-target-695dm" (UID: "082d0388-4d45-4560-9a2a-d7da02a5fc1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:42:58.792884 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.792825 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 09:37:57 +0000 UTC" deadline="2028-04-16 04:17:37.355414989 +0000 UTC" Sep 09 09:42:58.792884 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:58.792872 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14034h34m38.562545858s" Sep 09 09:42:58.951163 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:58.951131 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94844c18_18bb_41ff_84f8_0d9c5618b6ec.slice/crio-3cb3f1d885e921b823b6269916c55dc2ced5aa2b0a56765093c03d73093f1b3a WatchSource:0}: Error finding container 3cb3f1d885e921b823b6269916c55dc2ced5aa2b0a56765093c03d73093f1b3a: Status 404 returned error can't find the container with id 3cb3f1d885e921b823b6269916c55dc2ced5aa2b0a56765093c03d73093f1b3a Sep 09 09:42:58.952208 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:58.952171 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6508ea_5097_4929_a283_92337e4bab62.slice/crio-9a79bbad3f05a7bab86ee8f85b3aa5790cdda4de946c3ddd5e6ff9c217c913e4 WatchSource:0}: Error finding container 9a79bbad3f05a7bab86ee8f85b3aa5790cdda4de946c3ddd5e6ff9c217c913e4: Status 404 returned error can't find the container with id 9a79bbad3f05a7bab86ee8f85b3aa5790cdda4de946c3ddd5e6ff9c217c913e4 Sep 09 09:42:58.954067 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:58.953814 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947dc36a_67e2_48d1_bc1f_673e803ecb24.slice/crio-286707e0721effb5bc05ba78275bc07a36472723828337520f65ee5879a33e51 WatchSource:0}: Error finding container 286707e0721effb5bc05ba78275bc07a36472723828337520f65ee5879a33e51: Status 404 returned error can't find the container with id 286707e0721effb5bc05ba78275bc07a36472723828337520f65ee5879a33e51 Sep 09 09:42:58.956609 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:58.956584 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb683f88a_91f3_4b0d_8eca_01e01b15c2e6.slice/crio-90c6adec6089143d5059cb712c73ee6dae68866e342ad25cb4265cbb9282c057 WatchSource:0}: Error finding container 90c6adec6089143d5059cb712c73ee6dae68866e342ad25cb4265cbb9282c057: Status 404 returned error can't find the container with id 90c6adec6089143d5059cb712c73ee6dae68866e342ad25cb4265cbb9282c057 Sep 09 09:42:58.957513 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:58.957492 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14150818_ac39_4899_b393_13604e146532.slice/crio-58114d01d6490ed1801437042d495faf8411fc1d61c6acf683d8eb86579f0953 WatchSource:0}: Error finding container 58114d01d6490ed1801437042d495faf8411fc1d61c6acf683d8eb86579f0953: Status 404 returned error can't find the container with id 58114d01d6490ed1801437042d495faf8411fc1d61c6acf683d8eb86579f0953 Sep 09 09:42:58.959303 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:58.959279 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5747a3_029a_4f4a_9290_4ae6ca6537d5.slice/crio-c0ece4e38df772b3ff0b95e2a681d40a5a77c188154677a37a6de714284ce1af WatchSource:0}: Error finding container c0ece4e38df772b3ff0b95e2a681d40a5a77c188154677a37a6de714284ce1af: Status 404 returned error can't find the container with id c0ece4e38df772b3ff0b95e2a681d40a5a77c188154677a37a6de714284ce1af Sep 09 09:42:58.959783 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:58.959756 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f8c5be_7188_425d_8ea6_ae4ea9e58b83.slice/crio-9a4a4ebb327089e3ffb8764004f12ee05d684567ae1bee74b9f4eb64c9e9cc0e WatchSource:0}: Error finding container 9a4a4ebb327089e3ffb8764004f12ee05d684567ae1bee74b9f4eb64c9e9cc0e: Status 404 returned error can't find the container with id 9a4a4ebb327089e3ffb8764004f12ee05d684567ae1bee74b9f4eb64c9e9cc0e Sep 09 09:42:58.961495 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:58.961326 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4c2598_427a_4d10_b6be_7a7f83add348.slice/crio-19b9cc9833ede155734ba52fb95fdb86b6b62c993f5748c6055266d424040a4e WatchSource:0}: Error finding container 19b9cc9833ede155734ba52fb95fdb86b6b62c993f5748c6055266d424040a4e: Status 404 returned error can't find the container with id 19b9cc9833ede155734ba52fb95fdb86b6b62c993f5748c6055266d424040a4e Sep 09 09:42:58.962585 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:42:58.962556 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ad8ffb_35c6_46ee_b453_eba47783169f.slice/crio-b3d766c509cbbb8c70ad5a04cf932d26da1ab23747e39f625363b8676eced912 WatchSource:0}: Error finding container b3d766c509cbbb8c70ad5a04cf932d26da1ab23747e39f625363b8676eced912: Status 404 returned error can't find the container with id b3d766c509cbbb8c70ad5a04cf932d26da1ab23747e39f625363b8676eced912 Sep 09 09:42:59.379416 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.379137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:59.379576 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.379448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:42:59.379576 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.379371 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:42:59.379704 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.379625 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret podName:7dfb4a32-9282-4df8-b36e-0979d8ae92bf nodeName:}" failed. No retries permitted until 2026-09-09 09:43:01.37960563 +0000 UTC m=+6.040158812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret") pod "global-pull-secret-syncer-bzgh5" (UID: "7dfb4a32-9282-4df8-b36e-0979d8ae92bf") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:42:59.379987 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.379555 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:42:59.380110 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.380022 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:43:01.380005191 +0000 UTC m=+6.040558338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:42:59.480773 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.480653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:42:59.480962 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.480807 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:42:59.480962 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.480829 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:42:59.480962 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.480844 2578 projected.go:196] Error preparing data for projected volume kube-api-access-whq6t for pod openshift-network-diagnostics/network-check-target-695dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:42:59.480962 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.480904 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t podName:082d0388-4d45-4560-9a2a-d7da02a5fc1e nodeName:}" failed. No retries permitted until 2026-09-09 09:43:01.480886145 +0000 UTC m=+6.141439291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-whq6t" (UniqueName: "kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t") pod "network-check-target-695dm" (UID: "082d0388-4d45-4560-9a2a-d7da02a5fc1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:42:59.793467 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.793350 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 09:37:57 +0000 UTC" deadline="2028-06-26 06:16:52.435096162 +0000 UTC" Sep 09 09:42:59.793467 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.793396 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15740h33m52.64170531s" Sep 09 09:42:59.827295 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.827269 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:42:59.827441 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.827372 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:42:59.827786 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.827765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:42:59.827956 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.827886 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:42:59.828040 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.828000 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:42:59.828106 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:42:59.828085 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:42:59.851891 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.851857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r59lh" event={"ID":"9a4c2598-427a-4d10-b6be-7a7f83add348","Type":"ContainerStarted","Data":"19b9cc9833ede155734ba52fb95fdb86b6b62c993f5748c6055266d424040a4e"} Sep 09 09:42:59.870035 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.869996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" event={"ID":"17f8c5be-7188-425d-8ea6-ae4ea9e58b83","Type":"ContainerStarted","Data":"9a4a4ebb327089e3ffb8764004f12ee05d684567ae1bee74b9f4eb64c9e9cc0e"} Sep 09 09:42:59.873627 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.873568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-79hbs" event={"ID":"fd5747a3-029a-4f4a-9290-4ae6ca6537d5","Type":"ContainerStarted","Data":"c0ece4e38df772b3ff0b95e2a681d40a5a77c188154677a37a6de714284ce1af"} Sep 09 09:42:59.877151 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.877122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" event={"ID":"947dc36a-67e2-48d1-bc1f-673e803ecb24","Type":"ContainerStarted","Data":"286707e0721effb5bc05ba78275bc07a36472723828337520f65ee5879a33e51"} Sep 09 09:42:59.891671 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.891552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t6cps" event={"ID":"94844c18-18bb-41ff-84f8-0d9c5618b6ec","Type":"ContainerStarted","Data":"3cb3f1d885e921b823b6269916c55dc2ced5aa2b0a56765093c03d73093f1b3a"} Sep 09 09:42:59.905674 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.905643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" event={"ID":"bd219ac27246030f2e9ce6036a40244e","Type":"ContainerStarted","Data":"baedd5dc5782cff95b683b5e48123550eeb309f935fa288373d59fe7c3a47153"} Sep 09 09:42:59.918150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.918120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lp5bd" event={"ID":"b2ad8ffb-35c6-46ee-b453-eba47783169f","Type":"ContainerStarted","Data":"b3d766c509cbbb8c70ad5a04cf932d26da1ab23747e39f625363b8676eced912"} Sep 09 09:42:59.924086 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.923350 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" podStartSLOduration=3.923331832 podStartE2EDuration="3.923331832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:42:59.922749075 +0000 UTC m=+4.583302231" watchObservedRunningTime="2026-09-09 09:42:59.923331832 +0000 UTC m=+4.583884986" Sep 09 09:42:59.930621 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.930535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9tqgw" event={"ID":"14150818-ac39-4899-b393-13604e146532","Type":"ContainerStarted","Data":"58114d01d6490ed1801437042d495faf8411fc1d61c6acf683d8eb86579f0953"} Sep 09 09:42:59.947152 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.947104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgns5" event={"ID":"b683f88a-91f3-4b0d-8eca-01e01b15c2e6","Type":"ContainerStarted","Data":"90c6adec6089143d5059cb712c73ee6dae68866e342ad25cb4265cbb9282c057"} Sep 09 09:42:59.956651 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.956609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9d7r2" event={"ID":"4c6508ea-5097-4929-a283-92337e4bab62","Type":"ContainerStarted","Data":"9a79bbad3f05a7bab86ee8f85b3aa5790cdda4de946c3ddd5e6ff9c217c913e4"} Sep 09 09:42:59.978256 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.978219 2578 generic.go:356] "Generic (PLEG): container finished" podID="5dc4e778e86e846cbf55e64db17a6792" containerID="a44e6142e5d016440d488f0b637535f9c0866bdb8e5d04a39eccf0e3c420ad29" exitCode=0 Sep 09 09:42:59.978402 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:42:59.978268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" event={"ID":"5dc4e778e86e846cbf55e64db17a6792","Type":"ContainerDied","Data":"a44e6142e5d016440d488f0b637535f9c0866bdb8e5d04a39eccf0e3c420ad29"} Sep 09 09:43:01.007563 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:01.007519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" event={"ID":"5dc4e778e86e846cbf55e64db17a6792","Type":"ContainerStarted","Data":"149ba42a8a909b0dab42ab1662343abcf7ad246300d1139c0c7ffa655d81f954"} Sep 09 09:43:01.396895 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:01.396804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:01.396895 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:01.396890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:01.397125 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.397083 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:01.397158 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.397148 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:43:05.397129498 +0000 UTC m=+10.057682644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:01.397846 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.397548 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:01.397846 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.397593 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret podName:7dfb4a32-9282-4df8-b36e-0979d8ae92bf nodeName:}" failed. No retries permitted until 2026-09-09 09:43:05.397578612 +0000 UTC m=+10.058131757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret") pod "global-pull-secret-syncer-bzgh5" (UID: "7dfb4a32-9282-4df8-b36e-0979d8ae92bf") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:01.498142 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:01.497468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:01.498142 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.497641 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:01.498142 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.497661 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:01.498142 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.497674 2578 projected.go:196] Error preparing data for projected volume kube-api-access-whq6t for pod openshift-network-diagnostics/network-check-target-695dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:01.498142 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.497730 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t podName:082d0388-4d45-4560-9a2a-d7da02a5fc1e nodeName:}" failed. No retries permitted until 2026-09-09 09:43:05.497713863 +0000 UTC m=+10.158267009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-whq6t" (UniqueName: "kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t") pod "network-check-target-695dm" (UID: "082d0388-4d45-4560-9a2a-d7da02a5fc1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:01.830652 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:01.830550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:01.830808 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.830673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:01.831107 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:01.831086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:01.831244 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.831188 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:01.831335 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:01.831257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:01.831424 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:01.831393 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:03.829146 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:03.829109 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:03.829588 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:03.829204 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:03.829588 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:03.829472 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:03.829588 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:03.829541 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:03.829588 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:03.829579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:03.829730 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:03.829637 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:05.431132 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:05.431089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:05.431584 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:05.431166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:05.431584 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.431286 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:05.431584 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.431290 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:05.431584 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.431373 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:43:13.431353832 +0000 UTC m=+18.091906980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:05.431584 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.431393 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret podName:7dfb4a32-9282-4df8-b36e-0979d8ae92bf nodeName:}" failed. No retries permitted until 2026-09-09 09:43:13.43138367 +0000 UTC m=+18.091936819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret") pod "global-pull-secret-syncer-bzgh5" (UID: "7dfb4a32-9282-4df8-b36e-0979d8ae92bf") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:05.532357 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:05.532320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:05.532547 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.532509 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:05.532547 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.532534 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:05.532547 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.532546 2578 projected.go:196] Error preparing data for projected volume kube-api-access-whq6t for pod openshift-network-diagnostics/network-check-target-695dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:05.532773 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.532615 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t podName:082d0388-4d45-4560-9a2a-d7da02a5fc1e nodeName:}" failed. No retries permitted until 2026-09-09 09:43:13.532600017 +0000 UTC m=+18.193153168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-whq6t" (UniqueName: "kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t") pod "network-check-target-695dm" (UID: "082d0388-4d45-4560-9a2a-d7da02a5fc1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:05.827163 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:05.827090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:05.827287 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.827205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:05.827576 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:05.827552 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:05.827677 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.827653 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:05.827738 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:05.827711 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:05.827789 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:05.827758 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:07.827992 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:07.827909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:07.828427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:07.828038 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:07.828427 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:07.828054 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:07.828427 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:07.828072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:07.828427 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:07.828147 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:07.828427 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:07.828235 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:09.825011 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:09.824899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:09.825420 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:09.824899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:09.825420 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:09.825056 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:09.825420 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:09.824899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:09.825420 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:09.825132 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:09.825420 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:09.825205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:11.824266 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:11.824227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:11.824266 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:11.824268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:11.824756 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:11.824227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:11.824756 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:11.824363 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:11.824756 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:11.824465 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:11.824756 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:11.824548 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:13.491454 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:13.491416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:13.491884 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:13.491471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:13.491884 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.491570 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:13.491884 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.491578 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:13.491884 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.491636 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:43:29.491616315 +0000 UTC m=+34.152169470 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:13.491884 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.491656 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret podName:7dfb4a32-9282-4df8-b36e-0979d8ae92bf nodeName:}" failed. No retries permitted until 2026-09-09 09:43:29.491646201 +0000 UTC m=+34.152199338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret") pod "global-pull-secret-syncer-bzgh5" (UID: "7dfb4a32-9282-4df8-b36e-0979d8ae92bf") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:13.592196 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:13.592157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:13.592388 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.592357 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:13.592388 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.592390 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:13.592562 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.592401 2578 projected.go:196] Error preparing data for projected volume kube-api-access-whq6t for pod openshift-network-diagnostics/network-check-target-695dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:13.592562 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.592457 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t podName:082d0388-4d45-4560-9a2a-d7da02a5fc1e nodeName:}" failed. No retries permitted until 2026-09-09 09:43:29.592439622 +0000 UTC m=+34.252992752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-whq6t" (UniqueName: "kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t") pod "network-check-target-695dm" (UID: "082d0388-4d45-4560-9a2a-d7da02a5fc1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:13.824555 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:13.824484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:13.824722 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:13.824490 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:13.824722 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.824612 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:13.824722 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:13.824490 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:13.824722 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.824670 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:13.824937 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:13.824773 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:15.825724 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:15.825683 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:15.826142 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:15.825789 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:15.826142 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:15.826016 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:15.826142 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:15.826039 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:15.826292 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:15.826162 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:15.826292 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:15.826241 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:17.040165 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.039868 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r59lh" event={"ID":"9a4c2598-427a-4d10-b6be-7a7f83add348","Type":"ContainerStarted","Data":"13804570ff0bf26085ba0eeb210d256b8efef1e15221973487bab92057686404"} Sep 09 09:43:17.041837 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.041805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-79hbs" event={"ID":"fd5747a3-029a-4f4a-9290-4ae6ca6537d5","Type":"ContainerStarted","Data":"fec81c17c43b58a63848591e45649b7aaf67d1fd3f128f1aeaeafa73e18c6a6e"} Sep 09 09:43:17.044739 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.044526 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" event={"ID":"947dc36a-67e2-48d1-bc1f-673e803ecb24","Type":"ContainerStarted","Data":"59d065bc8571313f669efee85c120d0dd0ea1b9fff8d58f2d0a7d7c6eb69885e"} Sep 09 09:43:17.046647 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.046617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t6cps" event={"ID":"94844c18-18bb-41ff-84f8-0d9c5618b6ec","Type":"ContainerStarted","Data":"a340b93f3c508e496d6ec5498c208d3c15c85d79cc5e5c11427ded6041445fff"} Sep 09 09:43:17.049103 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.049079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lp5bd" event={"ID":"b2ad8ffb-35c6-46ee-b453-eba47783169f","Type":"ContainerStarted","Data":"fca1449db7721f112a946681485943af59713048985740da31913afc76a4f1c7"} Sep 09 09:43:17.050948 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.050894 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgns5" event={"ID":"b683f88a-91f3-4b0d-8eca-01e01b15c2e6","Type":"ContainerStarted","Data":"32b83155123ffe8c45e509827e133c87caa82bb40122064978d86fda4d4a6c9b"} Sep 09 09:43:17.056235 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.056154 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9d7r2" event={"ID":"4c6508ea-5097-4929-a283-92337e4bab62","Type":"ContainerStarted","Data":"824508144d2d0efe923d735a6bd3370122f46fc0f653764b03ed542390d3ba20"} Sep 09 09:43:17.056613 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.056527 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" podStartSLOduration=21.0565116 podStartE2EDuration="21.0565116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:01.022449474 +0000 UTC m=+5.683002628" watchObservedRunningTime="2026-09-09 09:43:17.0565116 +0000 UTC m=+21.717064754" Sep 09 09:43:17.070112 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.070059 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r59lh" podStartSLOduration=3.21997081 podStartE2EDuration="21.070038769s" totalImagesPullingTime="17.850067959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:17.056659237 +0000 UTC m=+21.717212391" watchObservedRunningTime="2026-09-09 09:43:17.070038769 +0000 UTC m=+21.730591923" Sep 09 09:43:17.070793 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.070747 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lp5bd" podStartSLOduration=3.220930755 podStartE2EDuration="21.070733942s" totalImagesPullingTime="17.849803187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:17.069622959 +0000 UTC m=+21.730176117" watchObservedRunningTime="2026-09-09 09:43:17.070733942 +0000 UTC m=+21.731287096" Sep 09 09:43:17.105654 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.105608 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9d7r2" podStartSLOduration=3.190107434 podStartE2EDuration="21.105590657s" totalImagesPullingTime="17.915483223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:17.08861445 +0000 UTC m=+21.749167631" watchObservedRunningTime="2026-09-09 09:43:17.105590657 +0000 UTC m=+21.766143811" Sep 09 09:43:17.123689 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.123631 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t6cps" podStartSLOduration=8.309788112 podStartE2EDuration="22.123615498s" totalImagesPullingTime="13.813827386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:17.105134646 +0000 UTC m=+21.765687796" watchObservedRunningTime="2026-09-09 09:43:17.123615498 +0000 UTC m=+21.784168650" Sep 09 09:43:17.153058 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.152856 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wgns5" podStartSLOduration=3.296485142 podStartE2EDuration="21.152840886s" totalImagesPullingTime="17.856355744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:17.152823219 +0000 UTC m=+21.813376404" watchObservedRunningTime="2026-09-09 09:43:17.152840886 +0000 UTC m=+21.813394050" Sep 09 09:43:17.827171 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.827136 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:17.827594 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.827176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:17.827594 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:17.827255 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:17.827594 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:17.827309 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:17.827594 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:17.827418 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:17.827594 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:17.827514 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:18.065029 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.064984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" event={"ID":"947dc36a-67e2-48d1-bc1f-673e803ecb24","Type":"ContainerStarted","Data":"5441dece565138147fc27ca9043781987d34fc7c379edb3a58dbc776a7d2ff34"} Sep 09 09:43:18.065768 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.065113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" event={"ID":"947dc36a-67e2-48d1-bc1f-673e803ecb24","Type":"ContainerStarted","Data":"36ed4e06cf0e175194732efc9996f170cec2ff93b4a6b24720e94c9349e8f14a"} Sep 09 09:43:18.065768 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.065171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" event={"ID":"947dc36a-67e2-48d1-bc1f-673e803ecb24","Type":"ContainerStarted","Data":"a3244b76ab246d9797bc248d7c4ddf01c7c5f8ece94aeccfb76735df1a785591"} Sep 09 09:43:18.065768 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.065218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" event={"ID":"947dc36a-67e2-48d1-bc1f-673e803ecb24","Type":"ContainerStarted","Data":"d5bac567e28ee634b1dbf0afad30b121d2d70c9ab1de7003df27f641af6084be"} Sep 09 09:43:18.065768 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.065269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" event={"ID":"947dc36a-67e2-48d1-bc1f-673e803ecb24","Type":"ContainerStarted","Data":"bb208a92707c2b11523cd9d336170bc7e66bfd6e8360f48d246a7bf73f136a66"} Sep 09 09:43:18.066829 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.066804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" event={"ID":"17f8c5be-7188-425d-8ea6-ae4ea9e58b83","Type":"ContainerStarted","Data":"b078c832c98ee8b70a11ba3b343d12de2bf0dd0e51fbc2e24208d2170aff3d79"} Sep 09 09:43:18.068554 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.068526 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd5747a3-029a-4f4a-9290-4ae6ca6537d5" containerID="fec81c17c43b58a63848591e45649b7aaf67d1fd3f128f1aeaeafa73e18c6a6e" exitCode=0 Sep 09 09:43:18.068679 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.068629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-79hbs" event={"ID":"fd5747a3-029a-4f4a-9290-4ae6ca6537d5","Type":"ContainerDied","Data":"fec81c17c43b58a63848591e45649b7aaf67d1fd3f128f1aeaeafa73e18c6a6e"} Sep 09 09:43:18.607206 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.607172 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 09:43:18.826011 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.825817 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T09:43:18.607204896Z","UUID":"77995faa-d80f-434f-ac24-77ac5b824edb","Handler":null,"Name":"","Endpoint":""} Sep 09 09:43:18.827384 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.827358 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 09:43:18.827384 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:18.827387 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 09:43:19.071939 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:19.071891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9tqgw" event={"ID":"14150818-ac39-4899-b393-13604e146532","Type":"ContainerStarted","Data":"8e20971723edb2a48d8d025ebf602e486eacfae305a98b80d91872806860d4c0"} Sep 09 09:43:19.074067 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:19.074036 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" event={"ID":"17f8c5be-7188-425d-8ea6-ae4ea9e58b83","Type":"ContainerStarted","Data":"70b94431dd890697b5a51ff5cd117ac498df75f276ab5bc038c9684aef5c4244"} Sep 09 09:43:19.085669 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:19.085586 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9tqgw" podStartSLOduration=5.233461638 podStartE2EDuration="23.085566126s" totalImagesPullingTime="17.852104488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:19.084701543 +0000 UTC m=+23.745254695" watchObservedRunningTime="2026-09-09 09:43:19.085566126 +0000 UTC m=+23.746119281" Sep 09 09:43:19.439794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:19.439712 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:43:19.440350 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:19.440320 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:43:19.828326 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:19.828254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:19.828465 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:19.828354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:19.828465 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:19.828362 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:19.828465 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:19.828379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:19.828643 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:19.828463 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:19.828643 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:19.828542 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:20.080263 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:20.080148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" event={"ID":"947dc36a-67e2-48d1-bc1f-673e803ecb24","Type":"ContainerStarted","Data":"3841d10c404cb7ec4f202b69c3d4e3fc0939a6204730a4b842fed381f42d1482"} Sep 09 09:43:20.080693 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:20.080460 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:43:20.080993 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:20.080956 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t6cps" Sep 09 09:43:21.083801 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:21.083765 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" event={"ID":"17f8c5be-7188-425d-8ea6-ae4ea9e58b83","Type":"ContainerStarted","Data":"8e8fbfa912c0d673edafde54de12d9ed23e28f711148dd7ae478de2c26fa3694"} Sep 09 09:43:21.100762 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:21.100712 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9p5h2" podStartSLOduration=5.318958609 podStartE2EDuration="26.100695928s" totalImagesPullingTime="20.781737319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:21.100430915 +0000 UTC m=+25.760984070" watchObservedRunningTime="2026-09-09 09:43:21.100695928 +0000 UTC m=+25.761249082" Sep 09 09:43:21.825079 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:21.824819 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:21.825248 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:21.824860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:21.825248 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:21.825193 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:21.825248 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:21.824903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:21.825401 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:21.825252 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:21.825401 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:21.825319 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:23.092310 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.092280 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" event={"ID":"947dc36a-67e2-48d1-bc1f-673e803ecb24","Type":"ContainerStarted","Data":"5dfd397c8e47e21f8957fa5dcf42b68660eb4c80262a71da3bf26e1e751c6bb1"} Sep 09 09:43:23.092877 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.092449 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:43:23.092877 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.092502 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:43:23.092877 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.092552 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:43:23.108975 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.108946 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:43:23.109116 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.109104 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:43:23.119314 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.119269 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" podStartSLOduration=9.202758628 podStartE2EDuration="27.119255336s" totalImagesPullingTime="17.916496708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:23.118861608 +0000 UTC m=+27.779414762" watchObservedRunningTime="2026-09-09 09:43:23.119255336 +0000 UTC m=+27.779808489" Sep 09 09:43:23.824503 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.824318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:23.824690 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.824328 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:23.824690 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:23.824571 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:23.824690 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:23.824385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:23.824690 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:23.824645 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:23.824905 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:23.824730 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:24.095999 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:24.095898 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd5747a3-029a-4f4a-9290-4ae6ca6537d5" containerID="b6736c395cf65aac818a9dea6a414111fa93ff7c8acb5e0e1844042f063b375f" exitCode=0 Sep 09 09:43:24.095999 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:24.095952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-79hbs" event={"ID":"fd5747a3-029a-4f4a-9290-4ae6ca6537d5","Type":"ContainerDied","Data":"b6736c395cf65aac818a9dea6a414111fa93ff7c8acb5e0e1844042f063b375f"} Sep 09 09:43:24.890212 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:24.890168 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-54f24"] Sep 09 09:43:24.890493 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:24.890301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:24.890493 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:24.890442 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:24.894327 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:24.894296 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-695dm"] Sep 09 09:43:24.894577 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:24.894398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:24.894577 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:24.894511 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:24.895048 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:24.895023 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bzgh5"] Sep 09 09:43:24.895152 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:24.895112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:24.895230 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:24.895210 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:26.103635 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:26.103558 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd5747a3-029a-4f4a-9290-4ae6ca6537d5" containerID="052dfe5a5334f7942fce91ca776ef18c793c2bd0fa0d45b8265b32d9f99d351a" exitCode=0 Sep 09 09:43:26.103635 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:26.103616 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-79hbs" event={"ID":"fd5747a3-029a-4f4a-9290-4ae6ca6537d5","Type":"ContainerDied","Data":"052dfe5a5334f7942fce91ca776ef18c793c2bd0fa0d45b8265b32d9f99d351a"} Sep 09 09:43:26.824870 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:26.824827 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:26.824870 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:26.824870 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:26.825286 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:26.824849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:26.825286 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:26.824999 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:26.825286 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:26.825125 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:26.825286 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:26.825222 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:28.110935 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:28.110677 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd5747a3-029a-4f4a-9290-4ae6ca6537d5" containerID="965ba21bad589d45ea906dadf8f8abb66099a15a6809cc2c264a4f81b17bc1a0" exitCode=0 Sep 09 09:43:28.111341 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:28.110753 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-79hbs" event={"ID":"fd5747a3-029a-4f4a-9290-4ae6ca6537d5","Type":"ContainerDied","Data":"965ba21bad589d45ea906dadf8f8abb66099a15a6809cc2c264a4f81b17bc1a0"} Sep 09 09:43:28.824332 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:28.824296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:28.824494 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:28.824426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:28.824494 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:28.824468 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:28.824494 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:28.824460 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzgh5" podUID="7dfb4a32-9282-4df8-b36e-0979d8ae92bf" Sep 09 09:43:28.824665 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:28.824594 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:43:28.824721 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:28.824693 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-695dm" podUID="082d0388-4d45-4560-9a2a-d7da02a5fc1e" Sep 09 09:43:29.505731 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.505698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:29.506219 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.505769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:29.506219 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:29.505860 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:29.506219 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:29.505860 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:29.506219 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:29.505947 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret podName:7dfb4a32-9282-4df8-b36e-0979d8ae92bf nodeName:}" failed. No retries permitted until 2026-09-09 09:44:01.505907884 +0000 UTC m=+66.166461040 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret") pod "global-pull-secret-syncer-bzgh5" (UID: "7dfb4a32-9282-4df8-b36e-0979d8ae92bf") : object "kube-system"/"original-pull-secret" not registered Sep 09 09:43:29.506219 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:29.505976 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:44:01.505964265 +0000 UTC m=+66.166517399 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 09:43:29.606774 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.606691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:29.606952 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:29.606840 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 09:43:29.606952 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:29.606861 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 09:43:29.606952 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:29.606872 2578 projected.go:196] Error preparing data for projected volume kube-api-access-whq6t for pod openshift-network-diagnostics/network-check-target-695dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:29.606952 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:29.606945 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t podName:082d0388-4d45-4560-9a2a-d7da02a5fc1e nodeName:}" failed. No retries permitted until 2026-09-09 09:44:01.606910436 +0000 UTC m=+66.267463568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-whq6t" (UniqueName: "kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t") pod "network-check-target-695dm" (UID: "082d0388-4d45-4560-9a2a-d7da02a5fc1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 09:43:29.682102 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.682069 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeReady" Sep 09 09:43:29.682277 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.682201 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 09:43:29.724568 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.724533 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kd79w"] Sep 09 09:43:29.747084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.747054 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kcgmg"] Sep 09 09:43:29.747274 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.747239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:29.749385 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.749357 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 09:43:29.749518 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.749410 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 09:43:29.749518 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.749456 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25h6q\"" Sep 09 09:43:29.763093 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.763072 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kcgmg"] Sep 09 09:43:29.763212 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.763100 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kd79w"] Sep 09 09:43:29.763270 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.763213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kcgmg" Sep 09 09:43:29.765209 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.765187 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-clsms\"" Sep 09 09:43:29.765368 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.765235 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 09:43:29.765368 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.765192 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 09:43:29.765368 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.765308 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 09:43:29.909797 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.909760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk9vb\" (UniqueName: \"kubernetes.io/projected/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-kube-api-access-fk9vb\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:29.910007 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.909810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-config-volume\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:29.910007 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.909834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:29.910007 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.909911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a724e969-f4a6-4ce5-9924-48e77fe7fa43-cert\") pod \"ingress-canary-kcgmg\" (UID: \"a724e969-f4a6-4ce5-9924-48e77fe7fa43\") " pod="openshift-ingress-canary/ingress-canary-kcgmg" Sep 09 09:43:29.910007 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.909987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pflt\" (UniqueName: \"kubernetes.io/projected/a724e969-f4a6-4ce5-9924-48e77fe7fa43-kube-api-access-2pflt\") pod \"ingress-canary-kcgmg\" (UID: \"a724e969-f4a6-4ce5-9924-48e77fe7fa43\") " pod="openshift-ingress-canary/ingress-canary-kcgmg" Sep 09 09:43:29.910219 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:29.910023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-tmp-dir\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:30.010469 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.010432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-tmp-dir\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:30.010967 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.010491 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk9vb\" (UniqueName: \"kubernetes.io/projected/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-kube-api-access-fk9vb\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:30.010967 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.010520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-config-volume\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:30.010967 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.010551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:30.010967 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.010583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a724e969-f4a6-4ce5-9924-48e77fe7fa43-cert\") pod \"ingress-canary-kcgmg\" (UID: \"a724e969-f4a6-4ce5-9924-48e77fe7fa43\") " pod="openshift-ingress-canary/ingress-canary-kcgmg" Sep 09 09:43:30.010967 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.010621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pflt\" (UniqueName: \"kubernetes.io/projected/a724e969-f4a6-4ce5-9924-48e77fe7fa43-kube-api-access-2pflt\") pod \"ingress-canary-kcgmg\" (UID: \"a724e969-f4a6-4ce5-9924-48e77fe7fa43\") " pod="openshift-ingress-canary/ingress-canary-kcgmg" Sep 09 09:43:30.010967 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:30.010742 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:30.010967 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:30.010821 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls podName:c1dc69d3-d3b8-4c2f-a087-d9921e7610ad nodeName:}" failed. No retries permitted until 2026-09-09 09:43:30.5108001 +0000 UTC m=+35.171353231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls") pod "dns-default-kd79w" (UID: "c1dc69d3-d3b8-4c2f-a087-d9921e7610ad") : secret "dns-default-metrics-tls" not found Sep 09 09:43:30.010967 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.010842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-tmp-dir\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:30.011318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.011135 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-config-volume\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:30.015558 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.015536 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a724e969-f4a6-4ce5-9924-48e77fe7fa43-cert\") pod \"ingress-canary-kcgmg\" (UID: \"a724e969-f4a6-4ce5-9924-48e77fe7fa43\") " pod="openshift-ingress-canary/ingress-canary-kcgmg" Sep 09 09:43:30.021348 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.021320 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk9vb\" (UniqueName: \"kubernetes.io/projected/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-kube-api-access-fk9vb\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:30.021661 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.021645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pflt\" (UniqueName: \"kubernetes.io/projected/a724e969-f4a6-4ce5-9924-48e77fe7fa43-kube-api-access-2pflt\") pod \"ingress-canary-kcgmg\" (UID: \"a724e969-f4a6-4ce5-9924-48e77fe7fa43\") " pod="openshift-ingress-canary/ingress-canary-kcgmg" Sep 09 09:43:30.072750 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.072712 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kcgmg" Sep 09 09:43:30.413320 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.413248 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kcgmg"] Sep 09 09:43:30.418384 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:43:30.418359 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda724e969_f4a6_4ce5_9924_48e77fe7fa43.slice/crio-aca369e63e540412b57975d63d832aa224193f0f37c972aa42c8661940756483 WatchSource:0}: Error finding container aca369e63e540412b57975d63d832aa224193f0f37c972aa42c8661940756483: Status 404 returned error can't find the container with id aca369e63e540412b57975d63d832aa224193f0f37c972aa42c8661940756483 Sep 09 09:43:30.515585 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.515496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:30.516279 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:30.515606 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:30.516279 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:30.515685 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls podName:c1dc69d3-d3b8-4c2f-a087-d9921e7610ad nodeName:}" failed. No retries permitted until 2026-09-09 09:43:31.515661544 +0000 UTC m=+36.176214679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls") pod "dns-default-kd79w" (UID: "c1dc69d3-d3b8-4c2f-a087-d9921e7610ad") : secret "dns-default-metrics-tls" not found Sep 09 09:43:30.824362 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.824281 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:43:30.824362 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.824348 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:43:30.824554 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.824369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:43:30.827307 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.827286 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 09:43:30.828522 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.828501 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 09:43:30.828642 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.828572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 09:43:30.828642 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.828619 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wwtw\"" Sep 09 09:43:30.828752 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.828502 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pm74b\"" Sep 09 09:43:30.829048 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:30.829031 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 09:43:31.120852 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:31.120758 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kcgmg" event={"ID":"a724e969-f4a6-4ce5-9924-48e77fe7fa43","Type":"ContainerStarted","Data":"aca369e63e540412b57975d63d832aa224193f0f37c972aa42c8661940756483"} Sep 09 09:43:31.523668 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:31.523629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:31.524149 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:31.523806 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:31.524149 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:31.523873 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls podName:c1dc69d3-d3b8-4c2f-a087-d9921e7610ad nodeName:}" failed. No retries permitted until 2026-09-09 09:43:33.52385596 +0000 UTC m=+38.184409090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls") pod "dns-default-kd79w" (UID: "c1dc69d3-d3b8-4c2f-a087-d9921e7610ad") : secret "dns-default-metrics-tls" not found Sep 09 09:43:33.130162 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:33.129779 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd5747a3-029a-4f4a-9290-4ae6ca6537d5" containerID="c128630832bbdea4b65e64a68e79d7ef432aa0440ef7b0f81f09892c4dd21b18" exitCode=0 Sep 09 09:43:33.130162 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:33.129871 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-79hbs" event={"ID":"fd5747a3-029a-4f4a-9290-4ae6ca6537d5","Type":"ContainerDied","Data":"c128630832bbdea4b65e64a68e79d7ef432aa0440ef7b0f81f09892c4dd21b18"} Sep 09 09:43:33.540132 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:33.540098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:33.540297 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:33.540275 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:33.540372 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:33.540356 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls podName:c1dc69d3-d3b8-4c2f-a087-d9921e7610ad nodeName:}" failed. No retries permitted until 2026-09-09 09:43:37.540334895 +0000 UTC m=+42.200888030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls") pod "dns-default-kd79w" (UID: "c1dc69d3-d3b8-4c2f-a087-d9921e7610ad") : secret "dns-default-metrics-tls" not found Sep 09 09:43:34.139798 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:34.139762 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd5747a3-029a-4f4a-9290-4ae6ca6537d5" containerID="79ab39f996be50618a263f10af36cf1de8b605fd3cb943cfd49a5c216519a47d" exitCode=0 Sep 09 09:43:34.140261 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:34.139837 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-79hbs" event={"ID":"fd5747a3-029a-4f4a-9290-4ae6ca6537d5","Type":"ContainerDied","Data":"79ab39f996be50618a263f10af36cf1de8b605fd3cb943cfd49a5c216519a47d"} Sep 09 09:43:35.145664 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:35.145630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-79hbs" event={"ID":"fd5747a3-029a-4f4a-9290-4ae6ca6537d5","Type":"ContainerStarted","Data":"ed68c50a67c614a5356ede921851db8890b85b3b90cd8fb0f77bc6037dac73cd"} Sep 09 09:43:35.147083 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:35.147059 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kcgmg" event={"ID":"a724e969-f4a6-4ce5-9924-48e77fe7fa43","Type":"ContainerStarted","Data":"1c05f12001909c9cd23557c90b844ffd645a9afa79eff3906dc29cb54428e46a"} Sep 09 09:43:35.167120 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:35.167066 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-79hbs" podStartSLOduration=9.042293901 podStartE2EDuration="39.167048261s" totalImagesPullingTime="30.12475436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:35.165586727 +0000 UTC m=+39.826139881" watchObservedRunningTime="2026-09-09 09:43:35.167048261 +0000 UTC m=+39.827601417" Sep 09 09:43:35.179977 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:35.179897 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kcgmg" podStartSLOduration=1.959725691 podStartE2EDuration="6.179883299s" totalImagesPullingTime="4.220157608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:43:35.179368319 +0000 UTC m=+39.839921473" watchObservedRunningTime="2026-09-09 09:43:35.179883299 +0000 UTC m=+39.840436452" Sep 09 09:43:37.569484 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:37.569441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:37.569868 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:37.569561 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:37.569868 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:37.569623 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls podName:c1dc69d3-d3b8-4c2f-a087-d9921e7610ad nodeName:}" failed. No retries permitted until 2026-09-09 09:43:45.569609384 +0000 UTC m=+50.230162528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls") pod "dns-default-kd79w" (UID: "c1dc69d3-d3b8-4c2f-a087-d9921e7610ad") : secret "dns-default-metrics-tls" not found Sep 09 09:43:45.626581 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:45.626528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:43:45.627047 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:45.626716 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:43:45.627047 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:43:45.626775 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls podName:c1dc69d3-d3b8-4c2f-a087-d9921e7610ad nodeName:}" failed. No retries permitted until 2026-09-09 09:44:01.626760758 +0000 UTC m=+66.287313889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls") pod "dns-default-kd79w" (UID: "c1dc69d3-d3b8-4c2f-a087-d9921e7610ad") : secret "dns-default-metrics-tls" not found Sep 09 09:43:55.115294 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:43:55.115268 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4x99" Sep 09 09:44:01.536909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.536855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:44:01.537336 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.536966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:44:01.539762 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.539742 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 09:44:01.539806 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.539776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 09:44:01.547733 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:44:01.547718 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 09:44:01.547787 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:44:01.547770 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:45:05.54775439 +0000 UTC m=+130.208307521 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : secret "metrics-daemon-secret" not found Sep 09 09:44:01.551022 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.550992 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dfb4a32-9282-4df8-b36e-0979d8ae92bf-original-pull-secret\") pod \"global-pull-secret-syncer-bzgh5\" (UID: \"7dfb4a32-9282-4df8-b36e-0979d8ae92bf\") " pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:44:01.637616 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.637579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:44:01.637786 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.637635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:44:01.637786 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:44:01.637723 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:44:01.637786 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:44:01.637775 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls podName:c1dc69d3-d3b8-4c2f-a087-d9921e7610ad nodeName:}" failed. No retries permitted until 2026-09-09 09:44:33.63776275 +0000 UTC m=+98.298315882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls") pod "dns-default-kd79w" (UID: "c1dc69d3-d3b8-4c2f-a087-d9921e7610ad") : secret "dns-default-metrics-tls" not found Sep 09 09:44:01.640054 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.640036 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 09:44:01.649806 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.649786 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 09:44:01.661052 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.661026 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whq6t\" (UniqueName: \"kubernetes.io/projected/082d0388-4d45-4560-9a2a-d7da02a5fc1e-kube-api-access-whq6t\") pod \"network-check-target-695dm\" (UID: \"082d0388-4d45-4560-9a2a-d7da02a5fc1e\") " pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:44:01.739126 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.739090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzgh5" Sep 09 09:44:01.748557 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.748537 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pm74b\"" Sep 09 09:44:01.756503 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:01.756471 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:44:02.014325 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:02.014289 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bzgh5"] Sep 09 09:44:02.018440 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:44:02.018412 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfb4a32_9282_4df8_b36e_0979d8ae92bf.slice/crio-2a7967f2dc93184816e25c58e67a7329ab13887e31fffc9ea29d32dd9fcb5ef2 WatchSource:0}: Error finding container 2a7967f2dc93184816e25c58e67a7329ab13887e31fffc9ea29d32dd9fcb5ef2: Status 404 returned error can't find the container with id 2a7967f2dc93184816e25c58e67a7329ab13887e31fffc9ea29d32dd9fcb5ef2 Sep 09 09:44:02.034963 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:02.034939 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-695dm"] Sep 09 09:44:02.037720 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:44:02.037697 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082d0388_4d45_4560_9a2a_d7da02a5fc1e.slice/crio-0f98ef0b8fd4684ac301d84b6c8f0a7e4abcace1f078be5ba68769014920b403 WatchSource:0}: Error finding container 0f98ef0b8fd4684ac301d84b6c8f0a7e4abcace1f078be5ba68769014920b403: Status 404 returned error can't find the container with id 0f98ef0b8fd4684ac301d84b6c8f0a7e4abcace1f078be5ba68769014920b403 Sep 09 09:44:02.214227 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:02.214185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-695dm" event={"ID":"082d0388-4d45-4560-9a2a-d7da02a5fc1e","Type":"ContainerStarted","Data":"0f98ef0b8fd4684ac301d84b6c8f0a7e4abcace1f078be5ba68769014920b403"} Sep 09 09:44:02.215275 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:02.215254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bzgh5" event={"ID":"7dfb4a32-9282-4df8-b36e-0979d8ae92bf","Type":"ContainerStarted","Data":"2a7967f2dc93184816e25c58e67a7329ab13887e31fffc9ea29d32dd9fcb5ef2"} Sep 09 09:44:07.231659 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:07.231622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-695dm" event={"ID":"082d0388-4d45-4560-9a2a-d7da02a5fc1e","Type":"ContainerStarted","Data":"22cef271cc9b8a74b2a33b84e7e18771d35aaecced6d3f2efff77da66517acb4"} Sep 09 09:44:07.232174 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:07.231754 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:44:07.233313 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:07.233290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bzgh5" event={"ID":"7dfb4a32-9282-4df8-b36e-0979d8ae92bf","Type":"ContainerStarted","Data":"581ffdd77a1d9abd9df14a5a0841b819a7bdbc1ee7c8c55a4768163e0b51d383"} Sep 09 09:44:07.247045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:07.246992 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-695dm" podStartSLOduration=67.543156182 podStartE2EDuration="1m12.246978438s" totalImagesPullingTime="4.703822256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:44:07.245737829 +0000 UTC m=+71.906290973" watchObservedRunningTime="2026-09-09 09:44:07.246978438 +0000 UTC m=+71.907531602" Sep 09 09:44:07.259157 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:07.259118 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bzgh5" podStartSLOduration=66.532488074 podStartE2EDuration="1m11.259106578s" totalImagesPullingTime="4.726618504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:44:07.258866973 +0000 UTC m=+71.919420127" watchObservedRunningTime="2026-09-09 09:44:07.259106578 +0000 UTC m=+71.919659731" Sep 09 09:44:33.644339 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:33.644285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:44:33.644860 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:44:33.644421 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:44:33.644860 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:44:33.644484 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls podName:c1dc69d3-d3b8-4c2f-a087-d9921e7610ad nodeName:}" failed. No retries permitted until 2026-09-09 09:45:37.64447064 +0000 UTC m=+162.305023771 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls") pod "dns-default-kd79w" (UID: "c1dc69d3-d3b8-4c2f-a087-d9921e7610ad") : secret "dns-default-metrics-tls" not found Sep 09 09:44:38.238526 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:38.238494 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-695dm" Sep 09 09:44:46.612469 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.612435 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx"] Sep 09 09:44:46.614123 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.614108 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.616313 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.616294 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 09 09:44:46.616984 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.616965 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 09:44:46.617283 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.617255 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 09 09:44:46.617386 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.617288 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 09:44:46.617386 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.617260 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 09:44:46.617386 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.617374 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 09 09:44:46.617527 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.617455 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 09 09:44:46.625569 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.625550 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx"] Sep 09 09:44:46.740711 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.740673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b400dd-ee9f-46ec-aa03-c284ac5523ca-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.740905 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.740734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-ca\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.740905 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.740753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-hub\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.740905 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.740778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.740905 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.740794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h99pw\" (UniqueName: \"kubernetes.io/projected/46b400dd-ee9f-46ec-aa03-c284ac5523ca-kube-api-access-h99pw\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.740905 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.740819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.841280 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.841226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b400dd-ee9f-46ec-aa03-c284ac5523ca-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.841449 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.841323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-ca\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.841449 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.841350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-hub\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.841449 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.841379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.841449 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.841401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h99pw\" (UniqueName: \"kubernetes.io/projected/46b400dd-ee9f-46ec-aa03-c284ac5523ca-kube-api-access-h99pw\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.841640 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.841554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.842089 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.842038 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b400dd-ee9f-46ec-aa03-c284ac5523ca-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.844074 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.844046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-hub\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.844185 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.844087 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.844185 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.844113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.844185 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.844139 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/46b400dd-ee9f-46ec-aa03-c284ac5523ca-ca\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.850295 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.850273 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h99pw\" (UniqueName: \"kubernetes.io/projected/46b400dd-ee9f-46ec-aa03-c284ac5523ca-kube-api-access-h99pw\") pod \"cluster-proxy-proxy-agent-6cc9b687ff-dlvqx\" (UID: \"46b400dd-ee9f-46ec-aa03-c284ac5523ca\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:46.927003 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:46.926974 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:44:47.197816 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:47.197745 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx"] Sep 09 09:44:47.200993 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:44:47.200968 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46b400dd_ee9f_46ec_aa03_c284ac5523ca.slice/crio-5bbdbfc20ef5ac8406ba000c6c5bb671e92a00e7735d9558370c75280fc6b34b WatchSource:0}: Error finding container 5bbdbfc20ef5ac8406ba000c6c5bb671e92a00e7735d9558370c75280fc6b34b: Status 404 returned error can't find the container with id 5bbdbfc20ef5ac8406ba000c6c5bb671e92a00e7735d9558370c75280fc6b34b Sep 09 09:44:47.327525 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:47.327490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" event={"ID":"46b400dd-ee9f-46ec-aa03-c284ac5523ca","Type":"ContainerStarted","Data":"5bbdbfc20ef5ac8406ba000c6c5bb671e92a00e7735d9558370c75280fc6b34b"} Sep 09 09:44:51.342786 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:51.342680 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" event={"ID":"46b400dd-ee9f-46ec-aa03-c284ac5523ca","Type":"ContainerStarted","Data":"43cf595d27e7681972e8774b88fbe8f10affa78437511711849f15dc18c1954a"} Sep 09 09:44:51.342786 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:51.342722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" event={"ID":"46b400dd-ee9f-46ec-aa03-c284ac5523ca","Type":"ContainerStarted","Data":"3452b24dd9ea7df1429ae1b74d2fedeedcb075eb3167a2da0ec77f8f78647756"} Sep 09 09:44:51.342786 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:51.342733 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" event={"ID":"46b400dd-ee9f-46ec-aa03-c284ac5523ca","Type":"ContainerStarted","Data":"87251282882bc84202c21fe82a1f98385884a835f1cb3602d8c00b262ec38138"} Sep 09 09:44:51.360894 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:44:51.360846 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" podStartSLOduration=1.6459648470000001 podStartE2EDuration="5.360830709s" totalImagesPullingTime="3.714865862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:44:51.359834125 +0000 UTC m=+116.020387298" watchObservedRunningTime="2026-09-09 09:44:51.360830709 +0000 UTC m=+116.021383861" Sep 09 09:45:05.579054 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:45:05.578997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:45:05.579532 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:45:05.579107 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 09:45:05.579532 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:45:05.579172 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:47:07.579157085 +0000 UTC m=+252.239710215 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : secret "metrics-daemon-secret" not found Sep 09 09:45:32.757629 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:45:32.757585 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kd79w" podUID="c1dc69d3-d3b8-4c2f-a087-d9921e7610ad" Sep 09 09:45:33.460053 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:45:33.460021 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kd79w" Sep 09 09:45:33.851753 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:45:33.851668 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:45:37.704784 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:45:37.704731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:45:37.705211 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:45:37.704887 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 09:45:37.705211 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:45:37.704995 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls podName:c1dc69d3-d3b8-4c2f-a087-d9921e7610ad nodeName:}" failed. No retries permitted until 2026-09-09 09:47:39.704978356 +0000 UTC m=+284.365531506 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls") pod "dns-default-kd79w" (UID: "c1dc69d3-d3b8-4c2f-a087-d9921e7610ad") : secret "dns-default-metrics-tls" not found Sep 09 09:45:45.825979 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:45:45.825945 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:47:07.601368 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:07.601311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:47:07.601852 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:07.601476 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 09:47:07.601852 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:07.601548 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs podName:6094a86f-2794-4ea2-8be5-3c8cd76fb69a nodeName:}" failed. No retries permitted until 2026-09-09 09:49:09.601532083 +0000 UTC m=+374.262085214 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs") pod "network-metrics-daemon-54f24" (UID: "6094a86f-2794-4ea2-8be5-3c8cd76fb69a") : secret "metrics-daemon-secret" not found Sep 09 09:47:15.681399 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.681360 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-2kz7l"] Sep 09 09:47:15.684220 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.684203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.687289 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.687268 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 09 09:47:15.687479 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.687461 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 09 09:47:15.688385 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.688368 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 09 09:47:15.689799 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.689777 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 09 09:47:15.690675 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.690650 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-j4gdt\"" Sep 09 09:47:15.694189 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.694171 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 09 09:47:15.698132 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.698113 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-2kz7l"] Sep 09 09:47:15.756565 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.756534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-config\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.756565 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.756564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-trusted-ca\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.756756 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.756619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccgl6\" (UniqueName: \"kubernetes.io/projected/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-kube-api-access-ccgl6\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.756756 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.756641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-serving-cert\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.857740 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.857703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-config\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.857740 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.857736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-trusted-ca\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.858026 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.857782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccgl6\" (UniqueName: \"kubernetes.io/projected/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-kube-api-access-ccgl6\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.858026 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.857813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-serving-cert\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.858558 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.858526 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-config\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.858756 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.858736 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-trusted-ca\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.860474 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.860448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-serving-cert\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.866071 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.866047 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccgl6\" (UniqueName: \"kubernetes.io/projected/18d954dd-3565-4bdb-8fd3-04f55fd4c69c-kube-api-access-ccgl6\") pod \"console-operator-85b454874b-2kz7l\" (UID: \"18d954dd-3565-4bdb-8fd3-04f55fd4c69c\") " pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:15.994037 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:15.993948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:16.261453 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:16.261385 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-2kz7l"] Sep 09 09:47:16.264879 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:47:16.264848 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d954dd_3565_4bdb_8fd3_04f55fd4c69c.slice/crio-5f1cf56b183da05789a3c783b06afa38001eb962b24d7521f6ad9442ef1a8670 WatchSource:0}: Error finding container 5f1cf56b183da05789a3c783b06afa38001eb962b24d7521f6ad9442ef1a8670: Status 404 returned error can't find the container with id 5f1cf56b183da05789a3c783b06afa38001eb962b24d7521f6ad9442ef1a8670 Sep 09 09:47:16.754909 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:16.754875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" event={"ID":"18d954dd-3565-4bdb-8fd3-04f55fd4c69c","Type":"ContainerStarted","Data":"5f1cf56b183da05789a3c783b06afa38001eb962b24d7521f6ad9442ef1a8670"} Sep 09 09:47:18.762044 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:18.762009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" event={"ID":"18d954dd-3565-4bdb-8fd3-04f55fd4c69c","Type":"ContainerStarted","Data":"95e06b26f5ae1afbe5ca44628e25da81117d92082796a82d806294de3a78038f"} Sep 09 09:47:18.762445 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:18.762226 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:18.763757 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:18.763710 2578 patch_prober.go:28] interesting pod/console-operator-85b454874b-2kz7l container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body= Sep 09 09:47:18.763894 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:18.763789 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" podUID="18d954dd-3565-4bdb-8fd3-04f55fd4c69c" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" Sep 09 09:47:18.777067 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:18.777020 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" podStartSLOduration=1.361179424 podStartE2EDuration="3.777005557s" totalImagesPullingTime="2.415826133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:18.776247988 +0000 UTC m=+263.436801141" watchObservedRunningTime="2026-09-09 09:47:18.777005557 +0000 UTC m=+263.437558749" Sep 09 09:47:19.542816 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.542777 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2"] Sep 09 09:47:19.545885 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.545869 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2" Sep 09 09:47:19.548178 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.548146 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 09 09:47:19.548753 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.548735 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 09 09:47:19.548799 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.548778 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-h6ptw\"" Sep 09 09:47:19.556967 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.556945 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2"] Sep 09 09:47:19.687338 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.687291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpsdx\" (UniqueName: \"kubernetes.io/projected/a68c1880-fe46-4118-afe5-1a768de4aad8-kube-api-access-tpsdx\") pod \"migrator-fdbb8fdff-b7wt2\" (UID: \"a68c1880-fe46-4118-afe5-1a768de4aad8\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2" Sep 09 09:47:19.766414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.766388 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/0.log" Sep 09 09:47:19.766745 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.766425 2578 generic.go:356] "Generic (PLEG): container finished" podID="18d954dd-3565-4bdb-8fd3-04f55fd4c69c" containerID="95e06b26f5ae1afbe5ca44628e25da81117d92082796a82d806294de3a78038f" exitCode=255 Sep 09 09:47:19.766745 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.766461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" event={"ID":"18d954dd-3565-4bdb-8fd3-04f55fd4c69c","Type":"ContainerDied","Data":"95e06b26f5ae1afbe5ca44628e25da81117d92082796a82d806294de3a78038f"} Sep 09 09:47:19.766745 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.766676 2578 scope.go:117] "RemoveContainer" containerID="95e06b26f5ae1afbe5ca44628e25da81117d92082796a82d806294de3a78038f" Sep 09 09:47:19.787857 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.787833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpsdx\" (UniqueName: \"kubernetes.io/projected/a68c1880-fe46-4118-afe5-1a768de4aad8-kube-api-access-tpsdx\") pod \"migrator-fdbb8fdff-b7wt2\" (UID: \"a68c1880-fe46-4118-afe5-1a768de4aad8\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2" Sep 09 09:47:19.795217 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.795167 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpsdx\" (UniqueName: \"kubernetes.io/projected/a68c1880-fe46-4118-afe5-1a768de4aad8-kube-api-access-tpsdx\") pod \"migrator-fdbb8fdff-b7wt2\" (UID: \"a68c1880-fe46-4118-afe5-1a768de4aad8\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2" Sep 09 09:47:19.854466 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:19.854418 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2" Sep 09 09:47:20.123584 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.123500 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2"] Sep 09 09:47:20.127559 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:47:20.127533 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68c1880_fe46_4118_afe5_1a768de4aad8.slice/crio-a77f55002eee7cb41346b34847828a763de0e4a35aec7b36e8d0ebc6f69dc649 WatchSource:0}: Error finding container a77f55002eee7cb41346b34847828a763de0e4a35aec7b36e8d0ebc6f69dc649: Status 404 returned error can't find the container with id a77f55002eee7cb41346b34847828a763de0e4a35aec7b36e8d0ebc6f69dc649 Sep 09 09:47:20.318881 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.318848 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f7778"] Sep 09 09:47:20.321990 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.321968 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.324446 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.324422 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 09:47:20.324549 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.324424 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 09:47:20.324549 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.324425 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 09:47:20.324652 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.324564 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dznl6\"" Sep 09 09:47:20.324743 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.324726 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 09:47:20.333283 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.333264 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f7778"] Sep 09 09:47:20.393057 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.393028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b110458-849e-46e1-a215-f94e004af7d0-data-volume\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.393226 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.393067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfhc\" (UniqueName: \"kubernetes.io/projected/9b110458-849e-46e1-a215-f94e004af7d0-kube-api-access-ggfhc\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.393226 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.393127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b110458-849e-46e1-a215-f94e004af7d0-crio-socket\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.393226 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.393155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.393226 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.393177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.494363 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.494330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b110458-849e-46e1-a215-f94e004af7d0-data-volume\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.494363 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.494362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfhc\" (UniqueName: \"kubernetes.io/projected/9b110458-849e-46e1-a215-f94e004af7d0-kube-api-access-ggfhc\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.494566 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.494386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b110458-849e-46e1-a215-f94e004af7d0-crio-socket\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.494566 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.494403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.494566 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.494427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.494566 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.494488 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b110458-849e-46e1-a215-f94e004af7d0-crio-socket\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.494566 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:20.494506 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:20.494566 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:20.494526 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:20.494822 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:20.494575 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:20.994556109 +0000 UTC m=+265.655109247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:20.494822 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:20.494594 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:20.994588185 +0000 UTC m=+265.655141316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : configmap "kube-rbac-proxy" not found Sep 09 09:47:20.494822 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.494699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b110458-849e-46e1-a215-f94e004af7d0-data-volume\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.501868 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.501844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfhc\" (UniqueName: \"kubernetes.io/projected/9b110458-849e-46e1-a215-f94e004af7d0-kube-api-access-ggfhc\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.771253 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.771182 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 09:47:20.771601 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.771517 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/0.log" Sep 09 09:47:20.771601 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.771551 2578 generic.go:356] "Generic (PLEG): container finished" podID="18d954dd-3565-4bdb-8fd3-04f55fd4c69c" containerID="6a572b1582ba067105d834bdec4eeea75136da75f70743880c3e94ab740b5c91" exitCode=255 Sep 09 09:47:20.771683 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.771621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" event={"ID":"18d954dd-3565-4bdb-8fd3-04f55fd4c69c","Type":"ContainerDied","Data":"6a572b1582ba067105d834bdec4eeea75136da75f70743880c3e94ab740b5c91"} Sep 09 09:47:20.771726 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.771689 2578 scope.go:117] "RemoveContainer" containerID="95e06b26f5ae1afbe5ca44628e25da81117d92082796a82d806294de3a78038f" Sep 09 09:47:20.771910 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.771883 2578 scope.go:117] "RemoveContainer" containerID="6a572b1582ba067105d834bdec4eeea75136da75f70743880c3e94ab740b5c91" Sep 09 09:47:20.772097 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:20.772077 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-2kz7l_openshift-console-operator(18d954dd-3565-4bdb-8fd3-04f55fd4c69c)\"" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" podUID="18d954dd-3565-4bdb-8fd3-04f55fd4c69c" Sep 09 09:47:20.772947 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.772773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2" event={"ID":"a68c1880-fe46-4118-afe5-1a768de4aad8","Type":"ContainerStarted","Data":"a77f55002eee7cb41346b34847828a763de0e4a35aec7b36e8d0ebc6f69dc649"} Sep 09 09:47:20.999541 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.999500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.999799 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:20.999552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:20.999799 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:20.999618 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:20.999799 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:20.999665 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:20.999799 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:20.999687 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:21.999668662 +0000 UTC m=+266.660221812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : configmap "kube-rbac-proxy" not found Sep 09 09:47:20.999799 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:20.999706 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:21.999694461 +0000 UTC m=+266.660247592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:21.777665 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:21.777630 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 09:47:21.778130 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:21.778012 2578 scope.go:117] "RemoveContainer" containerID="6a572b1582ba067105d834bdec4eeea75136da75f70743880c3e94ab740b5c91" Sep 09 09:47:21.778211 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:21.778187 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-2kz7l_openshift-console-operator(18d954dd-3565-4bdb-8fd3-04f55fd4c69c)\"" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" podUID="18d954dd-3565-4bdb-8fd3-04f55fd4c69c" Sep 09 09:47:21.779457 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:21.779435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2" event={"ID":"a68c1880-fe46-4118-afe5-1a768de4aad8","Type":"ContainerStarted","Data":"bc99779e402e450900607b6ecac9c9c668831e585a448c896361ffe15152bf5e"} Sep 09 09:47:21.779556 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:21.779500 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2" event={"ID":"a68c1880-fe46-4118-afe5-1a768de4aad8","Type":"ContainerStarted","Data":"a97bed116d83f6100007ae9717b79aa29da828bf1cb87610576c937dcaf9ecca"} Sep 09 09:47:21.812632 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:21.812586 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b7wt2" podStartSLOduration=1.577783943 podStartE2EDuration="2.812570201s" totalImagesPullingTime="1.234786258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:21.811413995 +0000 UTC m=+266.471967148" watchObservedRunningTime="2026-09-09 09:47:21.812570201 +0000 UTC m=+266.473123353" Sep 09 09:47:22.005809 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:22.005771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:22.005809 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:22.005811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:22.006076 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:22.005895 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:22.006076 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:22.005897 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:22.006076 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:22.005971 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:24.005954764 +0000 UTC m=+268.666507915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:22.006076 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:22.005987 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:24.005979272 +0000 UTC m=+268.666532403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : configmap "kube-rbac-proxy" not found Sep 09 09:47:23.097383 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:23.097358 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r59lh_9a4c2598-427a-4d10-b6be-7a7f83add348/dns-node-resolver/0.log" Sep 09 09:47:24.020476 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:24.020418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:24.020476 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:24.020472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:24.020748 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:24.020568 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:24.020748 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:24.020578 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:24.020748 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:24.020615 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:28.020601362 +0000 UTC m=+272.681154493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:24.020748 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:24.020640 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:28.020623567 +0000 UTC m=+272.681176713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : configmap "kube-rbac-proxy" not found Sep 09 09:47:24.097064 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:24.097036 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lp5bd_b2ad8ffb-35c6-46ee-b453-eba47783169f/node-ca/0.log" Sep 09 09:47:24.697741 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:24.697713 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kcgmg_a724e969-f4a6-4ce5-9924-48e77fe7fa43/serve-healthcheck-canary/0.log" Sep 09 09:47:25.298087 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:25.298057 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b7wt2_a68c1880-fe46-4118-afe5-1a768de4aad8/migrator/0.log" Sep 09 09:47:25.498979 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:25.498914 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b7wt2_a68c1880-fe46-4118-afe5-1a768de4aad8/graceful-termination/0.log" Sep 09 09:47:25.994355 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:25.994259 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:25.994715 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:25.994614 2578 scope.go:117] "RemoveContainer" containerID="6a572b1582ba067105d834bdec4eeea75136da75f70743880c3e94ab740b5c91" Sep 09 09:47:25.994771 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:25.994753 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-2kz7l_openshift-console-operator(18d954dd-3565-4bdb-8fd3-04f55fd4c69c)\"" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" podUID="18d954dd-3565-4bdb-8fd3-04f55fd4c69c" Sep 09 09:47:28.053392 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:28.053339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:28.053392 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:28.053390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:28.053820 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:28.053466 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 09:47:28.053820 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:28.053499 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 09:47:28.053820 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:28.053529 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:36.053514276 +0000 UTC m=+280.714067411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : configmap "kube-rbac-proxy" not found Sep 09 09:47:28.053820 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:28.053547 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls podName:9b110458-849e-46e1-a215-f94e004af7d0 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:36.05353529 +0000 UTC m=+280.714088421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f7778" (UID: "9b110458-849e-46e1-a215-f94e004af7d0") : secret "insights-runtime-extractor-tls" not found Sep 09 09:47:28.763216 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:28.763183 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:28.763529 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:28.763515 2578 scope.go:117] "RemoveContainer" containerID="6a572b1582ba067105d834bdec4eeea75136da75f70743880c3e94ab740b5c91" Sep 09 09:47:28.763666 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:28.763649 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-2kz7l_openshift-console-operator(18d954dd-3565-4bdb-8fd3-04f55fd4c69c)\"" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" podUID="18d954dd-3565-4bdb-8fd3-04f55fd4c69c" Sep 09 09:47:36.119182 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:36.119140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:36.119182 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:36.119179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:36.119671 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:36.119642 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b110458-849e-46e1-a215-f94e004af7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:36.121588 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:36.121569 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b110458-849e-46e1-a215-f94e004af7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7778\" (UID: \"9b110458-849e-46e1-a215-f94e004af7d0\") " pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:36.231004 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:36.230971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f7778" Sep 09 09:47:36.460891 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:36.460845 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kd79w" podUID="c1dc69d3-d3b8-4c2f-a087-d9921e7610ad" Sep 09 09:47:36.499462 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:36.499433 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f7778"] Sep 09 09:47:36.502382 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:47:36.502353 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b110458_849e_46e1_a215_f94e004af7d0.slice/crio-164d558925edd9443f062cbe6624863d3ab7ffdff967653dd9faa651737288f8 WatchSource:0}: Error finding container 164d558925edd9443f062cbe6624863d3ab7ffdff967653dd9faa651737288f8: Status 404 returned error can't find the container with id 164d558925edd9443f062cbe6624863d3ab7ffdff967653dd9faa651737288f8 Sep 09 09:47:36.823239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:36.823165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kd79w" Sep 09 09:47:36.823239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:36.823187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7778" event={"ID":"9b110458-849e-46e1-a215-f94e004af7d0","Type":"ContainerStarted","Data":"e6a192f65d470833c3366b0ac2787a3d0cbda7381f7ac55ee196d10633b8461d"} Sep 09 09:47:36.823239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:36.823235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7778" event={"ID":"9b110458-849e-46e1-a215-f94e004af7d0","Type":"ContainerStarted","Data":"164d558925edd9443f062cbe6624863d3ab7ffdff967653dd9faa651737288f8"} Sep 09 09:47:37.828231 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:37.828191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7778" event={"ID":"9b110458-849e-46e1-a215-f94e004af7d0","Type":"ContainerStarted","Data":"33f8ad9f72f7315ce02fc8e736d2027c9a0833bfdc74fb041e2f56480da4dfa6"} Sep 09 09:47:39.746935 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:39.746864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:47:39.749349 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:39.749330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1dc69d3-d3b8-4c2f-a087-d9921e7610ad-metrics-tls\") pod \"dns-default-kd79w\" (UID: \"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad\") " pod="openshift-dns/dns-default-kd79w" Sep 09 09:47:39.826583 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:39.826553 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-25h6q\"" Sep 09 09:47:39.834934 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:39.834900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kd79w" Sep 09 09:47:39.837744 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:39.837686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7778" event={"ID":"9b110458-849e-46e1-a215-f94e004af7d0","Type":"ContainerStarted","Data":"9920331db2fea814721c1d08051e48bad41aa351362420b7ae9e4e6c9ef0ea77"} Sep 09 09:47:39.854079 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:39.853907 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f7778" podStartSLOduration=17.539361705 podStartE2EDuration="19.853891908s" totalImagesPullingTime="2.314530203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 09:47:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:39.85369011 +0000 UTC m=+284.514243264" watchObservedRunningTime="2026-09-09 09:47:39.853891908 +0000 UTC m=+284.514445060" Sep 09 09:47:40.105150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:40.105073 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kd79w"] Sep 09 09:47:40.108142 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:47:40.108107 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1dc69d3_d3b8_4c2f_a087_d9921e7610ad.slice/crio-046070a272eac2b0ea40eb62885815a4176748f13d14831ab374c25e3cf99906 WatchSource:0}: Error finding container 046070a272eac2b0ea40eb62885815a4176748f13d14831ab374c25e3cf99906: Status 404 returned error can't find the container with id 046070a272eac2b0ea40eb62885815a4176748f13d14831ab374c25e3cf99906 Sep 09 09:47:40.846258 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:40.846204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kd79w" event={"ID":"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad","Type":"ContainerStarted","Data":"046070a272eac2b0ea40eb62885815a4176748f13d14831ab374c25e3cf99906"} Sep 09 09:47:41.852150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:41.852115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kd79w" event={"ID":"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad","Type":"ContainerStarted","Data":"08c7f0eb3a31f9ea2b58000c4fd96584a53999611bba0aca0b8921b7d49773c3"} Sep 09 09:47:42.856669 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:42.856632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kd79w" event={"ID":"c1dc69d3-d3b8-4c2f-a087-d9921e7610ad","Type":"ContainerStarted","Data":"b9498a1572d3c9b7507b8cabb13bbe96870cd91988b0305ee88a53c09ae7bd77"} Sep 09 09:47:42.857067 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:42.856774 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kd79w" Sep 09 09:47:42.873799 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:42.873732 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kd79w" podStartSLOduration=252.267494662 podStartE2EDuration="4m13.873717892s" totalImagesPullingTime="1.60622323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:47:42.87249264 +0000 UTC m=+287.533045792" watchObservedRunningTime="2026-09-09 09:47:42.873717892 +0000 UTC m=+287.534271039" Sep 09 09:47:43.825299 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:43.825269 2578 scope.go:117] "RemoveContainer" containerID="6a572b1582ba067105d834bdec4eeea75136da75f70743880c3e94ab740b5c91" Sep 09 09:47:44.864995 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:44.864967 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 09:47:44.865374 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:44.865051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" event={"ID":"18d954dd-3565-4bdb-8fd3-04f55fd4c69c","Type":"ContainerStarted","Data":"d492680edb169af724c8544340f0b1e93acbd20394a3dc40f58a63fc87472061"} Sep 09 09:47:44.865374 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:44.865309 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:44.869785 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:44.869761 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-2kz7l" Sep 09 09:47:48.826673 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:48.826627 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-54f24" podUID="6094a86f-2794-4ea2-8be5-3c8cd76fb69a" Sep 09 09:47:52.862600 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:52.862567 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kd79w" Sep 09 09:47:55.751439 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:55.751409 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 09:47:55.754600 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:55.754568 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 09:47:55.761941 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:55.761900 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 09:47:58.713877 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.713834 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs"] Sep 09 09:47:58.717863 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.717826 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cnmll"] Sep 09 09:47:58.718003 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.717965 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.720319 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.720294 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 09 09:47:58.720442 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.720426 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 09:47:58.720626 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.720610 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 09 09:47:58.721123 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.721104 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.721255 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.721234 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 09:47:58.721321 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.721298 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 09 09:47:58.721376 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.721332 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dzfd2\"" Sep 09 09:47:58.721476 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.721462 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 09:47:58.723731 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.723714 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 09:47:58.724270 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.724251 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 09:47:58.724491 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.724475 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 09:47:58.724491 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.724487 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2rn2r\"" Sep 09 09:47:58.730362 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.730343 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs"] Sep 09 09:47:58.777688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.777849 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777701 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-wtmp\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.777849 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777724 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-textfile\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.777849 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-metrics-client-ca\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.777849 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d4817587-f391-4998-9183-54087b2cbacc-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.777849 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jhz7\" (UniqueName: \"kubernetes.io/projected/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-kube-api-access-5jhz7\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.778046 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.778046 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv94m\" (UniqueName: \"kubernetes.io/projected/d4817587-f391-4998-9183-54087b2cbacc-kube-api-access-bv94m\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.778046 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.778046 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.777983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4817587-f391-4998-9183-54087b2cbacc-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.778046 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.778009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.778190 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.778056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.778190 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.778076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-root\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.778190 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.778093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-tls\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.778190 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.778146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-sys\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.878787 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.878750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.878787 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.878787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4817587-f391-4998-9183-54087b2cbacc-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.879025 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.878810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.879025 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.878846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879025 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.878870 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-root\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879025 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.878894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-tls\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879025 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.878990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-root\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879025 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:58.879016 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-sys\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:58.879091 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-tls podName:31fb153f-fe00-4e0d-9e1b-07e2bcd06276 nodeName:}" failed. No retries permitted until 2026-09-09 09:47:59.37907153 +0000 UTC m=+304.039624662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-tls") pod "node-exporter-cnmll" (UID: "31fb153f-fe00-4e0d-9e1b-07e2bcd06276") : secret "node-exporter-tls" not found Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:58.879017 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879130 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-sys\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-wtmp\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-textfile\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:58.879184 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-tls podName:d4817587-f391-4998-9183-54087b2cbacc nodeName:}" failed. No retries permitted until 2026-09-09 09:47:59.379162803 +0000 UTC m=+304.039715949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-6fvcs" (UID: "d4817587-f391-4998-9183-54087b2cbacc") : secret "kube-state-metrics-tls" not found Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-metrics-client-ca\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879275 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d4817587-f391-4998-9183-54087b2cbacc-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.879775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jhz7\" (UniqueName: \"kubernetes.io/projected/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-kube-api-access-5jhz7\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.879775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv94m\" (UniqueName: \"kubernetes.io/projected/d4817587-f391-4998-9183-54087b2cbacc-kube-api-access-bv94m\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.879775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879456 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-textfile\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879510 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-wtmp\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.879775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879628 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4817587-f391-4998-9183-54087b2cbacc-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.879775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.879716 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d4817587-f391-4998-9183-54087b2cbacc-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.880106 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.880090 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.880249 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.880229 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-metrics-client-ca\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.881568 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.881539 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.881674 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.881572 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:58.890222 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.890197 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jhz7\" (UniqueName: \"kubernetes.io/projected/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-kube-api-access-5jhz7\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:58.890317 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:58.890230 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv94m\" (UniqueName: \"kubernetes.io/projected/d4817587-f391-4998-9183-54087b2cbacc-kube-api-access-bv94m\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:59.383464 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.383423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:59.383676 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.383478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-tls\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:59.385929 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.385901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31fb153f-fe00-4e0d-9e1b-07e2bcd06276-node-exporter-tls\") pod \"node-exporter-cnmll\" (UID: \"31fb153f-fe00-4e0d-9e1b-07e2bcd06276\") " pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:59.386061 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.385981 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4817587-f391-4998-9183-54087b2cbacc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-6fvcs\" (UID: \"d4817587-f391-4998-9183-54087b2cbacc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:59.629034 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.629004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" Sep 09 09:47:59.632959 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.632941 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cnmll" Sep 09 09:47:59.645144 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:47:59.645103 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31fb153f_fe00_4e0d_9e1b_07e2bcd06276.slice/crio-771da7a2991acd078c39e714169e0008132987abb8ac86d45995401e40b75f3b WatchSource:0}: Error finding container 771da7a2991acd078c39e714169e0008132987abb8ac86d45995401e40b75f3b: Status 404 returned error can't find the container with id 771da7a2991acd078c39e714169e0008132987abb8ac86d45995401e40b75f3b Sep 09 09:47:59.647482 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.647462 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 09:47:59.758096 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.758061 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 09:47:59.762782 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.762765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.766662 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.766637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 09:47:59.766768 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.766658 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 09:47:59.766768 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.766683 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 09:47:59.766768 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.766728 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 09:47:59.766768 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.766741 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 09:47:59.766768 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.766643 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 09:47:59.767064 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.766885 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 09:47:59.767135 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.767119 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 09:47:59.767135 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.767131 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q9jkd\"" Sep 09 09:47:59.767238 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.767147 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 09:47:59.778484 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.778463 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 09:47:59.786593 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-config-volume\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.786694 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.786694 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-web-config\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.786694 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.786694 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-config-out\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.786840 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.786840 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9l6z\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-kube-api-access-p9l6z\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.786840 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.786840 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.786840 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.787016 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.787016 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.787016 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.786905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.887876 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.887799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-config-volume\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.887876 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.887844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.887876 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.887874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-web-config\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.888153 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.887898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.888153 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.887946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-config-out\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.888467 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.888229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.888467 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.888293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9l6z\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-kube-api-access-p9l6z\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.888467 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.888356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.889689 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.889235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.889689 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.888565 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.889689 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.889365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.889689 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.889394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.889689 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.889418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.889689 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.889452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.890142 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.889699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.890808 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:47:59.890654 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-trusted-ca-bundle podName:dab3e713-642a-47ec-86bb-de7fef9c866d nodeName:}" failed. No retries permitted until 2026-09-09 09:48:00.390632816 +0000 UTC m=+305.051185954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d") : configmap references non-existent config key: ca-bundle.crt Sep 09 09:47:59.891732 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.891488 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.891943 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.891896 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-config-out\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.892293 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.892275 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-config-volume\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.892778 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.892758 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.893095 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.893059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.893223 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.893204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.893629 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.893607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.893946 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.893901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-web-config\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.894186 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.894171 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.896589 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.896573 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9l6z\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-kube-api-access-p9l6z\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:47:59.908045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.908023 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs"] Sep 09 09:47:59.913874 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:47:59.913708 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4817587_f391_4998_9183_54087b2cbacc.slice/crio-8656ba6c1f37fa2cd62a06b207f6db04616fa7ecc2b37b96a88c3ec94e16f6f9 WatchSource:0}: Error finding container 8656ba6c1f37fa2cd62a06b207f6db04616fa7ecc2b37b96a88c3ec94e16f6f9: Status 404 returned error can't find the container with id 8656ba6c1f37fa2cd62a06b207f6db04616fa7ecc2b37b96a88c3ec94e16f6f9 Sep 09 09:47:59.917166 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:47:59.917134 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnmll" event={"ID":"31fb153f-fe00-4e0d-9e1b-07e2bcd06276","Type":"ContainerStarted","Data":"771da7a2991acd078c39e714169e0008132987abb8ac86d45995401e40b75f3b"} Sep 09 09:48:00.394314 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:00.394279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:48:00.395496 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:00.395464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:48:00.672337 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:00.672309 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:48:00.929325 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:00.929237 2578 generic.go:356] "Generic (PLEG): container finished" podID="31fb153f-fe00-4e0d-9e1b-07e2bcd06276" containerID="662187d223dbc370d136fe46987c30271aa0710869e3c6df102ea0f60f897c15" exitCode=0 Sep 09 09:48:00.929741 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:00.929321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnmll" event={"ID":"31fb153f-fe00-4e0d-9e1b-07e2bcd06276","Type":"ContainerDied","Data":"662187d223dbc370d136fe46987c30271aa0710869e3c6df102ea0f60f897c15"} Sep 09 09:48:00.931442 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:00.931394 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" event={"ID":"d4817587-f391-4998-9183-54087b2cbacc","Type":"ContainerStarted","Data":"8656ba6c1f37fa2cd62a06b207f6db04616fa7ecc2b37b96a88c3ec94e16f6f9"} Sep 09 09:48:00.966354 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:00.966326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 09:48:00.970934 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:48:00.970888 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab3e713_642a_47ec_86bb_de7fef9c866d.slice/crio-c8c21ad469f38b1859e44f63644012d5114dc054c3db8141d4a5231619d68fdd WatchSource:0}: Error finding container c8c21ad469f38b1859e44f63644012d5114dc054c3db8141d4a5231619d68fdd: Status 404 returned error can't find the container with id c8c21ad469f38b1859e44f63644012d5114dc054c3db8141d4a5231619d68fdd Sep 09 09:48:01.392030 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.392000 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-795ddd5b7b-vj2mb"] Sep 09 09:48:01.395071 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.395050 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.397800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.397775 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mw824\"" Sep 09 09:48:01.397964 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.397862 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 09:48:01.397964 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.397862 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 09:48:01.398061 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.397965 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 09:48:01.398061 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.398015 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 09:48:01.398289 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.398276 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 09:48:01.398464 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.398447 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 09:48:01.398530 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.398518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 09:48:01.403754 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.403737 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 09:48:01.407078 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.407058 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795ddd5b7b-vj2mb"] Sep 09 09:48:01.502827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.502797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-trusted-ca-bundle\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.502965 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.502843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjsb\" (UniqueName: \"kubernetes.io/projected/15ac9d48-0661-4391-96c7-63c9a19c3a0c-kube-api-access-zdjsb\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.502965 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.502938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-oauth-config\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.503068 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.503003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-serving-cert\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.503068 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.503027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-config\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.503068 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.503055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-service-ca\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.503182 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.503072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-oauth-serving-cert\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.603692 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.603652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-oauth-config\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.603692 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.603692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-serving-cert\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.603944 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.603712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-config\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.603944 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.603735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-service-ca\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.603944 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.603748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-oauth-serving-cert\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.603944 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.603814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-trusted-ca-bundle\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.603944 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.603829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjsb\" (UniqueName: \"kubernetes.io/projected/15ac9d48-0661-4391-96c7-63c9a19c3a0c-kube-api-access-zdjsb\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.604775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.604458 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-service-ca\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.604775 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.604718 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-config\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.604969 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.604838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-oauth-serving-cert\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.605246 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.605218 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-trusted-ca-bundle\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.608039 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.608003 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-serving-cert\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.608142 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.608054 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-oauth-config\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.614565 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.614510 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjsb\" (UniqueName: \"kubernetes.io/projected/15ac9d48-0661-4391-96c7-63c9a19c3a0c-kube-api-access-zdjsb\") pod \"console-795ddd5b7b-vj2mb\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.704603 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.704520 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:01.939686 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.939650 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnmll" event={"ID":"31fb153f-fe00-4e0d-9e1b-07e2bcd06276","Type":"ContainerStarted","Data":"5d70c0eb4baf163de86a30c57d6dd152b051f219582c9a8725d40d0bee94cd18"} Sep 09 09:48:01.940219 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.939711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnmll" event={"ID":"31fb153f-fe00-4e0d-9e1b-07e2bcd06276","Type":"ContainerStarted","Data":"0f06550fbddb8423dcfc608627b888b390881852dd3760fefed3dc49f934a366"} Sep 09 09:48:01.942274 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.942246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" event={"ID":"d4817587-f391-4998-9183-54087b2cbacc","Type":"ContainerStarted","Data":"293e792b87dd18e5efa24e753acb229c4b8e2772657393ea7353a3d81684c54b"} Sep 09 09:48:01.942386 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.942302 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" event={"ID":"d4817587-f391-4998-9183-54087b2cbacc","Type":"ContainerStarted","Data":"7270eb006755d638c578e92c084948fcaf4627af32e07c9aa82c4e7f678789ef"} Sep 09 09:48:01.942386 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.942331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" event={"ID":"d4817587-f391-4998-9183-54087b2cbacc","Type":"ContainerStarted","Data":"8f862e572565097b61fd1bb90f1ae2cc7956b23be6b359c089aae8100eb8ff46"} Sep 09 09:48:01.944024 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.943991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerStarted","Data":"c8c21ad469f38b1859e44f63644012d5114dc054c3db8141d4a5231619d68fdd"} Sep 09 09:48:01.965875 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.965424 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cnmll" podStartSLOduration=2.93583122 podStartE2EDuration="3.965401366s" totalImagesPullingTime="950.71038ms" totalInitContainerRuntime="78.859766ms" isStatefulPod=true podCreationTimestamp="2026-09-09 09:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:48:01.964401516 +0000 UTC m=+306.624954669" watchObservedRunningTime="2026-09-09 09:48:01.965401366 +0000 UTC m=+306.625954541" Sep 09 09:48:01.985489 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.985429 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-6fvcs" podStartSLOduration=2.46521105 podStartE2EDuration="3.985408569s" totalImagesPullingTime="1.520197519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:48:01.984191305 +0000 UTC m=+306.644744459" watchObservedRunningTime="2026-09-09 09:48:01.985408569 +0000 UTC m=+306.645961723" Sep 09 09:48:01.994407 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:01.994100 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795ddd5b7b-vj2mb"] Sep 09 09:48:02.002393 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:48:02.002368 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ac9d48_0661_4391_96c7_63c9a19c3a0c.slice/crio-260f074109628284c3f4f87cabab08c16abb92336d53fbde0eb206f83124dc2d WatchSource:0}: Error finding container 260f074109628284c3f4f87cabab08c16abb92336d53fbde0eb206f83124dc2d: Status 404 returned error can't find the container with id 260f074109628284c3f4f87cabab08c16abb92336d53fbde0eb206f83124dc2d Sep 09 09:48:02.950023 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:02.949984 2578 generic.go:356] "Generic (PLEG): container finished" podID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerID="ffc03a290c26240c8de4a99d719b3be1b2a052b5a5cc6f1eaa95e5fc3b0c41de" exitCode=0 Sep 09 09:48:02.950486 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:02.950075 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerDied","Data":"ffc03a290c26240c8de4a99d719b3be1b2a052b5a5cc6f1eaa95e5fc3b0c41de"} Sep 09 09:48:02.951836 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:02.951806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795ddd5b7b-vj2mb" event={"ID":"15ac9d48-0661-4391-96c7-63c9a19c3a0c","Type":"ContainerStarted","Data":"260f074109628284c3f4f87cabab08c16abb92336d53fbde0eb206f83124dc2d"} Sep 09 09:48:03.825101 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:03.825062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:48:04.961371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:04.961327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795ddd5b7b-vj2mb" event={"ID":"15ac9d48-0661-4391-96c7-63c9a19c3a0c","Type":"ContainerStarted","Data":"54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc"} Sep 09 09:48:04.982979 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:04.982827 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-795ddd5b7b-vj2mb" podStartSLOduration=1.26271997 podStartE2EDuration="3.982803034s" totalImagesPullingTime="2.720083064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:48:04.982779967 +0000 UTC m=+309.643333120" watchObservedRunningTime="2026-09-09 09:48:04.982803034 +0000 UTC m=+309.643356191" Sep 09 09:48:05.008443 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.008411 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 09:48:05.012673 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.012649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.015555 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.015526 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 09:48:05.015688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.015634 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w46qx\"" Sep 09 09:48:05.015688 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.015634 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 09:48:05.016266 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.016206 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 09:48:05.016266 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.016251 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 09:48:05.016488 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.016334 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 09:48:05.016488 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.016407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 09:48:05.016610 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.016575 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 09:48:05.016657 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.016609 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 09:48:05.016830 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.016815 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 09:48:05.017143 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.017102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 09:48:05.017361 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.017344 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 09:48:05.017616 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.017491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 09:48:05.017616 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.017565 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 09:48:05.017616 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.017608 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 09:48:05.018183 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.017981 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3qvvk9d5tftat\"" Sep 09 09:48:05.018858 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.018840 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 09:48:05.031510 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.031485 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 09:48:05.137462 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137646 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137646 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137542 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137646 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dpkh\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-kube-api-access-7dpkh\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137646 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137646 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137941 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137941 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137941 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-web-config\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137941 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137941 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.137941 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.138239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.137949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.138239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.138005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.138239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.138041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.138239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.138067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.138239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.138095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.138239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.138125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config-out\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.138239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.138176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.138239 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.138205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.238739 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.238739 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.238739 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config-out\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.238981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239045 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239898 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239898 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239898 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dpkh\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-kube-api-access-7dpkh\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239898 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239898 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239898 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239898 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.239898 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.239278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-web-config\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.240384 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.240016 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.241109 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.240501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.241109 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.240586 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.241109 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.240968 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.241109 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.240980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.241109 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.241028 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.241728 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.241434 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.243008 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.242965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.245785 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.244966 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.245785 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.245222 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.245785 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.245397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config-out\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.245785 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.245749 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.246066 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.245827 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-web-config\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.246066 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.245996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.246586 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.246189 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.246586 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.246520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.246586 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.246547 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.247393 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.247372 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.247508 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.247431 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.251380 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.251362 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dpkh\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-kube-api-access-7dpkh\") pod \"prometheus-k8s-0\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.324892 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.324854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:05.608272 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.608149 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 09:48:05.712506 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:48:05.712475 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27dda31_10e4_45c2_9f52_1f1efe8fb45c.slice/crio-51405c36e3067d8dd6bb82ffba9569979d24aeb55d1c6e029432fd8736e1feaa WatchSource:0}: Error finding container 51405c36e3067d8dd6bb82ffba9569979d24aeb55d1c6e029432fd8736e1feaa: Status 404 returned error can't find the container with id 51405c36e3067d8dd6bb82ffba9569979d24aeb55d1c6e029432fd8736e1feaa Sep 09 09:48:05.967318 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.967291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerStarted","Data":"936c7c1771cbd98449407608cdb0e38a398a04516b798868d18bcac1eac4dc9f"} Sep 09 09:48:05.967614 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.967355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerStarted","Data":"895b6a9de12e95c8d750ce42ea8a704da7ffad82243f559492a1bf3f9feb5464"} Sep 09 09:48:05.968677 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.968650 2578 generic.go:356] "Generic (PLEG): container finished" podID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerID="609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80" exitCode=0 Sep 09 09:48:05.968780 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.968731 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerDied","Data":"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80"} Sep 09 09:48:05.968836 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:05.968797 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerStarted","Data":"51405c36e3067d8dd6bb82ffba9569979d24aeb55d1c6e029432fd8736e1feaa"} Sep 09 09:48:06.980561 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:06.980468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerStarted","Data":"537c7735d6d6c906c3981f195e0b9bbd4dd0fe9c02a9f78143db167b9c784c78"} Sep 09 09:48:06.980561 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:06.980545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerStarted","Data":"bafed435b1a0eae869c4c227320049bd2959133710300f2107a83257a0393110"} Sep 09 09:48:06.981141 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:06.980581 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerStarted","Data":"db2bf82b78e8dc3b5bf7614ad68105c4d31131709de390bb0a642309c7028a19"} Sep 09 09:48:07.989079 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:07.989041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerStarted","Data":"fee592813b60580af1c41575298c60f1afba79d33f1f24fd187d9584fb229b51"} Sep 09 09:48:08.015618 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:08.015556 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.67436681 podStartE2EDuration="9.015535522s" totalImagesPullingTime="5.321708197s" totalInitContainerRuntime="19.460515ms" isStatefulPod=false podCreationTimestamp="2026-09-09 09:47:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:48:08.014505038 +0000 UTC m=+312.675058216" watchObservedRunningTime="2026-09-09 09:48:08.015535522 +0000 UTC m=+312.676088677" Sep 09 09:48:09.998978 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:09.998942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerStarted","Data":"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af"} Sep 09 09:48:09.999343 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:09.999006 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerStarted","Data":"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e"} Sep 09 09:48:11.704956 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:11.704904 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:11.705338 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:11.705000 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:11.709759 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:11.709736 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:12.009599 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:12.009505 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerStarted","Data":"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861"} Sep 09 09:48:12.009599 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:12.009575 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerStarted","Data":"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd"} Sep 09 09:48:12.009792 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:12.009620 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerStarted","Data":"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54"} Sep 09 09:48:12.009792 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:12.009657 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerStarted","Data":"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6"} Sep 09 09:48:12.014389 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:12.014365 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:12.037031 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:12.036966 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.075574732 podStartE2EDuration="8.036945158s" totalImagesPullingTime="4.945835519s" totalInitContainerRuntime="15.534907ms" isStatefulPod=false podCreationTimestamp="2026-09-09 09:48:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:48:12.035487488 +0000 UTC m=+316.696040669" watchObservedRunningTime="2026-09-09 09:48:12.036945158 +0000 UTC m=+316.697498327" Sep 09 09:48:15.326035 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:15.325997 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:48:19.175800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:19.175764 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795ddd5b7b-vj2mb"] Sep 09 09:48:36.928438 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:36.928393 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" podUID="46b400dd-ee9f-46ec-aa03-c284ac5523ca" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 09:48:44.204073 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.204003 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-795ddd5b7b-vj2mb" podUID="15ac9d48-0661-4391-96c7-63c9a19c3a0c" containerName="console" containerID="cri-o://54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc" gracePeriod=15 Sep 09 09:48:44.447260 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.447238 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:44.486450 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486362 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-trusted-ca-bundle\") pod \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " Sep 09 09:48:44.486450 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486416 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-service-ca\") pod \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " Sep 09 09:48:44.486450 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486446 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-oauth-serving-cert\") pod \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " Sep 09 09:48:44.486694 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486496 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-oauth-config\") pod \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " Sep 09 09:48:44.486694 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486522 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdjsb\" (UniqueName: \"kubernetes.io/projected/15ac9d48-0661-4391-96c7-63c9a19c3a0c-kube-api-access-zdjsb\") pod \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " Sep 09 09:48:44.486694 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486664 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-config\") pod \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " Sep 09 09:48:44.486838 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486731 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-serving-cert\") pod \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\" (UID: \"15ac9d48-0661-4391-96c7-63c9a19c3a0c\") " Sep 09 09:48:44.486838 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486797 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "15ac9d48-0661-4391-96c7-63c9a19c3a0c" (UID: "15ac9d48-0661-4391-96c7-63c9a19c3a0c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:48:44.486967 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486862 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-service-ca" (OuterVolumeSpecName: "service-ca") pod "15ac9d48-0661-4391-96c7-63c9a19c3a0c" (UID: "15ac9d48-0661-4391-96c7-63c9a19c3a0c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:48:44.487030 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.486982 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "15ac9d48-0661-4391-96c7-63c9a19c3a0c" (UID: "15ac9d48-0661-4391-96c7-63c9a19c3a0c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:48:44.487088 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.487034 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-config" (OuterVolumeSpecName: "console-config") pod "15ac9d48-0661-4391-96c7-63c9a19c3a0c" (UID: "15ac9d48-0661-4391-96c7-63c9a19c3a0c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:48:44.487169 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.487154 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:48:44.487206 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.487174 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-trusted-ca-bundle\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:48:44.487206 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.487184 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-service-ca\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:48:44.487206 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.487196 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15ac9d48-0661-4391-96c7-63c9a19c3a0c-oauth-serving-cert\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:48:44.488957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.488931 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ac9d48-0661-4391-96c7-63c9a19c3a0c-kube-api-access-zdjsb" (OuterVolumeSpecName: "kube-api-access-zdjsb") pod "15ac9d48-0661-4391-96c7-63c9a19c3a0c" (UID: "15ac9d48-0661-4391-96c7-63c9a19c3a0c"). InnerVolumeSpecName "kube-api-access-zdjsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:48:44.489433 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.489411 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "15ac9d48-0661-4391-96c7-63c9a19c3a0c" (UID: "15ac9d48-0661-4391-96c7-63c9a19c3a0c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:48:44.489433 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.489421 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "15ac9d48-0661-4391-96c7-63c9a19c3a0c" (UID: "15ac9d48-0661-4391-96c7-63c9a19c3a0c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:48:44.588606 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.588574 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-serving-cert\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:48:44.588606 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.588602 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15ac9d48-0661-4391-96c7-63c9a19c3a0c-console-oauth-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:48:44.588606 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:44.588613 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdjsb\" (UniqueName: \"kubernetes.io/projected/15ac9d48-0661-4391-96c7-63c9a19c3a0c-kube-api-access-zdjsb\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:48:45.138898 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.138864 2578 generic.go:356] "Generic (PLEG): container finished" podID="15ac9d48-0661-4391-96c7-63c9a19c3a0c" containerID="54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc" exitCode=0 Sep 09 09:48:45.139076 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.138932 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795ddd5b7b-vj2mb" Sep 09 09:48:45.139076 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.138935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795ddd5b7b-vj2mb" event={"ID":"15ac9d48-0661-4391-96c7-63c9a19c3a0c","Type":"ContainerDied","Data":"54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc"} Sep 09 09:48:45.139076 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.139045 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795ddd5b7b-vj2mb" event={"ID":"15ac9d48-0661-4391-96c7-63c9a19c3a0c","Type":"ContainerDied","Data":"260f074109628284c3f4f87cabab08c16abb92336d53fbde0eb206f83124dc2d"} Sep 09 09:48:45.139076 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.139064 2578 scope.go:117] "RemoveContainer" containerID="54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc" Sep 09 09:48:45.147635 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.147619 2578 scope.go:117] "RemoveContainer" containerID="54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc" Sep 09 09:48:45.147911 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:48:45.147892 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc\": container with ID starting with 54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc not found: ID does not exist" containerID="54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc" Sep 09 09:48:45.147998 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.147946 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc"} err="failed to get container status \"54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc\": rpc error: code = NotFound desc = could not find container \"54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc\": container with ID starting with 54eb660a1e01c3c4f3290ed5cc924d9a4fe37b954be2834444401083e92be6cc not found: ID does not exist" Sep 09 09:48:45.159872 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.159847 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795ddd5b7b-vj2mb"] Sep 09 09:48:45.164687 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.164666 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-795ddd5b7b-vj2mb"] Sep 09 09:48:45.829442 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:45.829407 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ac9d48-0661-4391-96c7-63c9a19c3a0c" path="/var/lib/kubelet/pods/15ac9d48-0661-4391-96c7-63c9a19c3a0c/volumes" Sep 09 09:48:46.928426 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:46.928337 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" podUID="46b400dd-ee9f-46ec-aa03-c284ac5523ca" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 09:48:56.928052 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:56.928014 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" podUID="46b400dd-ee9f-46ec-aa03-c284ac5523ca" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 09:48:56.928508 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:56.928084 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" Sep 09 09:48:56.928571 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:56.928554 2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"43cf595d27e7681972e8774b88fbe8f10affa78437511711849f15dc18c1954a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 09 09:48:56.928610 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:56.928590 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" podUID="46b400dd-ee9f-46ec-aa03-c284ac5523ca" containerName="service-proxy" containerID="cri-o://43cf595d27e7681972e8774b88fbe8f10affa78437511711849f15dc18c1954a" gracePeriod=30 Sep 09 09:48:57.189074 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:57.188995 2578 generic.go:356] "Generic (PLEG): container finished" podID="46b400dd-ee9f-46ec-aa03-c284ac5523ca" containerID="43cf595d27e7681972e8774b88fbe8f10affa78437511711849f15dc18c1954a" exitCode=2 Sep 09 09:48:57.189074 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:57.189044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" event={"ID":"46b400dd-ee9f-46ec-aa03-c284ac5523ca","Type":"ContainerDied","Data":"43cf595d27e7681972e8774b88fbe8f10affa78437511711849f15dc18c1954a"} Sep 09 09:48:57.189249 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:48:57.189076 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cc9b687ff-dlvqx" event={"ID":"46b400dd-ee9f-46ec-aa03-c284ac5523ca","Type":"ContainerStarted","Data":"df3f2feed65e83c7fb8f58cc06597563621fe3aba5601e6e70595cbe52f0ba1f"} Sep 09 09:49:05.325528 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:05.325491 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:05.344372 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:05.344343 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:06.238987 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:06.238905 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:09.604899 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:09.604859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:49:09.607286 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:09.607269 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6094a86f-2794-4ea2-8be5-3c8cd76fb69a-metrics-certs\") pod \"network-metrics-daemon-54f24\" (UID: \"6094a86f-2794-4ea2-8be5-3c8cd76fb69a\") " pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:49:09.828356 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:09.828286 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wwtw\"" Sep 09 09:49:09.836710 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:09.836687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54f24" Sep 09 09:49:10.107119 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:10.107043 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-54f24"] Sep 09 09:49:10.239123 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:10.239040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54f24" event={"ID":"6094a86f-2794-4ea2-8be5-3c8cd76fb69a","Type":"ContainerStarted","Data":"2ba3081fd8cf3d1f38cad5ee324c28e759437a46e47ebfd4b4228fcd83614a43"} Sep 09 09:49:11.245124 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:11.245089 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54f24" event={"ID":"6094a86f-2794-4ea2-8be5-3c8cd76fb69a","Type":"ContainerStarted","Data":"1f7077009197856c616933690ff1f54891acd6586a4def05b3c4d27f85d4c30f"} Sep 09 09:49:11.245467 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:11.245141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54f24" event={"ID":"6094a86f-2794-4ea2-8be5-3c8cd76fb69a","Type":"ContainerStarted","Data":"0e3d1423928528100452369379f3156b425bf5840df04edb6789965378b79227"} Sep 09 09:49:11.261752 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:11.261702 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-54f24" podStartSLOduration=374.333379141 podStartE2EDuration="6m15.261687523s" totalImagesPullingTime="928.308382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 09:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:49:11.260753325 +0000 UTC m=+375.921306476" watchObservedRunningTime="2026-09-09 09:49:11.261687523 +0000 UTC m=+375.922240674" Sep 09 09:49:19.052009 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.051974 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 09:49:19.052482 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.052315 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="alertmanager" containerID="cri-o://895b6a9de12e95c8d750ce42ea8a704da7ffad82243f559492a1bf3f9feb5464" gracePeriod=120 Sep 09 09:49:19.052482 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.052369 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy-metric" containerID="cri-o://537c7735d6d6c906c3981f195e0b9bbd4dd0fe9c02a9f78143db167b9c784c78" gracePeriod=120 Sep 09 09:49:19.052482 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.052389 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="prom-label-proxy" containerID="cri-o://fee592813b60580af1c41575298c60f1afba79d33f1f24fd187d9584fb229b51" gracePeriod=120 Sep 09 09:49:19.052482 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.052427 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy-web" containerID="cri-o://db2bf82b78e8dc3b5bf7614ad68105c4d31131709de390bb0a642309c7028a19" gracePeriod=120 Sep 09 09:49:19.052482 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.052441 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy" containerID="cri-o://bafed435b1a0eae869c4c227320049bd2959133710300f2107a83257a0393110" gracePeriod=120 Sep 09 09:49:19.052760 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.052463 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="config-reloader" containerID="cri-o://936c7c1771cbd98449407608cdb0e38a398a04516b798868d18bcac1eac4dc9f" gracePeriod=120 Sep 09 09:49:19.281348 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.281313 2578 generic.go:356] "Generic (PLEG): container finished" podID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerID="fee592813b60580af1c41575298c60f1afba79d33f1f24fd187d9584fb229b51" exitCode=0 Sep 09 09:49:19.281348 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.281341 2578 generic.go:356] "Generic (PLEG): container finished" podID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerID="bafed435b1a0eae869c4c227320049bd2959133710300f2107a83257a0393110" exitCode=0 Sep 09 09:49:19.281348 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.281348 2578 generic.go:356] "Generic (PLEG): container finished" podID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerID="936c7c1771cbd98449407608cdb0e38a398a04516b798868d18bcac1eac4dc9f" exitCode=0 Sep 09 09:49:19.281348 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.281355 2578 generic.go:356] "Generic (PLEG): container finished" podID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerID="895b6a9de12e95c8d750ce42ea8a704da7ffad82243f559492a1bf3f9feb5464" exitCode=0 Sep 09 09:49:19.281594 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.281388 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerDied","Data":"fee592813b60580af1c41575298c60f1afba79d33f1f24fd187d9584fb229b51"} Sep 09 09:49:19.281594 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.281455 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerDied","Data":"bafed435b1a0eae869c4c227320049bd2959133710300f2107a83257a0393110"} Sep 09 09:49:19.281594 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.281480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerDied","Data":"936c7c1771cbd98449407608cdb0e38a398a04516b798868d18bcac1eac4dc9f"} Sep 09 09:49:19.281594 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:19.281505 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerDied","Data":"895b6a9de12e95c8d750ce42ea8a704da7ffad82243f559492a1bf3f9feb5464"} Sep 09 09:49:20.288730 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.288704 2578 generic.go:356] "Generic (PLEG): container finished" podID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerID="537c7735d6d6c906c3981f195e0b9bbd4dd0fe9c02a9f78143db167b9c784c78" exitCode=0 Sep 09 09:49:20.288730 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.288726 2578 generic.go:356] "Generic (PLEG): container finished" podID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerID="db2bf82b78e8dc3b5bf7614ad68105c4d31131709de390bb0a642309c7028a19" exitCode=0 Sep 09 09:49:20.289072 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.288779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerDied","Data":"537c7735d6d6c906c3981f195e0b9bbd4dd0fe9c02a9f78143db167b9c784c78"} Sep 09 09:49:20.289072 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.288860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerDied","Data":"db2bf82b78e8dc3b5bf7614ad68105c4d31131709de390bb0a642309c7028a19"} Sep 09 09:49:20.289072 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.288898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dab3e713-642a-47ec-86bb-de7fef9c866d","Type":"ContainerDied","Data":"c8c21ad469f38b1859e44f63644012d5114dc054c3db8141d4a5231619d68fdd"} Sep 09 09:49:20.289072 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.288946 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8c21ad469f38b1859e44f63644012d5114dc054c3db8141d4a5231619d68fdd" Sep 09 09:49:20.291112 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.291099 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:49:20.389838 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.389757 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-cluster-tls-config\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.389838 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.389791 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-trusted-ca-bundle\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.389838 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.389824 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-config-out\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.389848 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-web\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.389884 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-config-volume\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.389907 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.389949 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-tls-assets\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.389976 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.390025 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-metrics-client-ca\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.390053 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9l6z\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-kube-api-access-p9l6z\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.390079 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-main-tls\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.390102 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-web-config\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390129 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.390125 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-main-db\") pod \"dab3e713-642a-47ec-86bb-de7fef9c866d\" (UID: \"dab3e713-642a-47ec-86bb-de7fef9c866d\") " Sep 09 09:49:20.390774 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.390297 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:49:20.390774 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.390388 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.390774 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.390606 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:49:20.391250 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.391217 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:49:20.393183 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.393153 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:20.393306 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.393225 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:49:20.393306 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.393237 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-config-out" (OuterVolumeSpecName: "config-out") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:49:20.393641 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.393614 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-kube-api-access-p9l6z" (OuterVolumeSpecName: "kube-api-access-p9l6z") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "kube-api-access-p9l6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:49:20.394091 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.394052 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:20.394200 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.394099 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-config-volume" (OuterVolumeSpecName: "config-volume") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:20.394368 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.394342 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:20.394949 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.394891 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:20.397559 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.397541 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:20.403234 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.403213 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-web-config" (OuterVolumeSpecName: "web-config") pod "dab3e713-642a-47ec-86bb-de7fef9c866d" (UID: "dab3e713-642a-47ec-86bb-de7fef9c866d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:20.491460 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491414 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-cluster-tls-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491460 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491454 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-config-out\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491460 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491464 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491460 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491474 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-config-volume\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491755 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491484 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491755 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491494 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-tls-assets\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491755 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491504 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491755 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491514 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dab3e713-642a-47ec-86bb-de7fef9c866d-metrics-client-ca\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491755 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491522 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9l6z\" (UniqueName: \"kubernetes.io/projected/dab3e713-642a-47ec-86bb-de7fef9c866d-kube-api-access-p9l6z\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491755 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491530 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-secret-alertmanager-main-tls\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491755 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491537 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dab3e713-642a-47ec-86bb-de7fef9c866d-web-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:20.491755 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:20.491545 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dab3e713-642a-47ec-86bb-de7fef9c866d-alertmanager-main-db\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:21.292076 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:21.292047 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 09:49:21.315472 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:21.315435 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 09:49:21.323839 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:21.323815 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 09:49:21.829966 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:21.829910 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" path="/var/lib/kubelet/pods/dab3e713-642a-47ec-86bb-de7fef9c866d/volumes" Sep 09 09:49:23.395196 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.395164 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 09:49:23.395598 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.395431 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy" containerID="cri-o://a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" gracePeriod=600 Sep 09 09:49:23.395598 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.395484 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" gracePeriod=600 Sep 09 09:49:23.395598 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.395506 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy-web" containerID="cri-o://ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" gracePeriod=600 Sep 09 09:49:23.395598 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.395428 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="prometheus" containerID="cri-o://a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" gracePeriod=600 Sep 09 09:49:23.395598 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.395492 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="config-reloader" containerID="cri-o://f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" gracePeriod=600 Sep 09 09:49:23.395598 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.395495 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="thanos-sidecar" containerID="cri-o://40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" gracePeriod=600 Sep 09 09:49:23.646372 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.646299 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:23.714202 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714171 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-tls-assets\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714373 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714221 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-kubelet-serving-ca-bundle\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714373 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714252 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dpkh\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-kube-api-access-7dpkh\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714373 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714275 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-trusted-ca-bundle\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714373 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714297 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-thanos-prometheus-http-client-file\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714373 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714334 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714373 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714365 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-2\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714667 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714388 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-0\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714667 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714419 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-web-config\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714667 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714446 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714667 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714471 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-tls\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714667 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714502 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-db\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714667 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714529 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config-out\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714667 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714560 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-metrics-client-ca\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714667 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714599 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.714667 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714629 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-1\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.715084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714672 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-grpc-tls\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.715084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714697 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-metrics-client-certs\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.715084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714702 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:49:23.715084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714739 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-kube-rbac-proxy\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.715084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714740 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:49:23.715084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.714771 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-serving-certs-ca-bundle\") pod \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\" (UID: \"c27dda31-10e4-45c2-9f52-1f1efe8fb45c\") " Sep 09 09:49:23.715084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.715000 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.715084 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.715019 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.715448 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.715131 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:49:23.715448 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.715364 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:49:23.715448 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.715436 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:49:23.716368 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.716337 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:49:23.717555 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.717525 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:49:23.717651 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.717563 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 09:49:23.718406 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.718377 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:49:23.718492 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.718474 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-kube-api-access-7dpkh" (OuterVolumeSpecName: "kube-api-access-7dpkh") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "kube-api-access-7dpkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 09:49:23.718644 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.718623 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config" (OuterVolumeSpecName: "config") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:23.718741 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.718657 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:23.718911 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.718864 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:23.719115 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.719091 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config-out" (OuterVolumeSpecName: "config-out") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 09:49:23.719414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.719396 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:23.720051 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.720012 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:23.720648 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.720628 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:23.720711 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.720676 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:23.721716 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.721698 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:23.729161 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.729142 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-web-config" (OuterVolumeSpecName: "web-config") pod "c27dda31-10e4-45c2-9f52-1f1efe8fb45c" (UID: "c27dda31-10e4-45c2-9f52-1f1efe8fb45c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 09:49:23.815670 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815625 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815670 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815665 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815670 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815675 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-grpc-tls\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815670 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815683 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-metrics-client-certs\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815693 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-kube-rbac-proxy\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815701 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815710 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-tls-assets\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815718 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dpkh\" (UniqueName: \"kubernetes.io/projected/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-kube-api-access-7dpkh\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815726 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815734 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815742 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815750 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815758 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-web-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815767 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815776 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815783 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-prometheus-k8s-db\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815791 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-config-out\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:23.815957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:23.815798 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c27dda31-10e4-45c2-9f52-1f1efe8fb45c-configmap-metrics-client-ca\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Sep 09 09:49:24.305383 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305344 2578 generic.go:356] "Generic (PLEG): container finished" podID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerID="cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" exitCode=0 Sep 09 09:49:24.305383 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305373 2578 generic.go:356] "Generic (PLEG): container finished" podID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerID="a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" exitCode=0 Sep 09 09:49:24.305383 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305381 2578 generic.go:356] "Generic (PLEG): container finished" podID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerID="ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" exitCode=0 Sep 09 09:49:24.305383 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305386 2578 generic.go:356] "Generic (PLEG): container finished" podID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerID="40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" exitCode=0 Sep 09 09:49:24.305383 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305391 2578 generic.go:356] "Generic (PLEG): container finished" podID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerID="f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" exitCode=0 Sep 09 09:49:24.305383 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305395 2578 generic.go:356] "Generic (PLEG): container finished" podID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerID="a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" exitCode=0 Sep 09 09:49:24.305800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerDied","Data":"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861"} Sep 09 09:49:24.305800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305430 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.305800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305483 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerDied","Data":"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd"} Sep 09 09:49:24.305800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerDied","Data":"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54"} Sep 09 09:49:24.305800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerDied","Data":"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6"} Sep 09 09:49:24.305800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerDied","Data":"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af"} Sep 09 09:49:24.305800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305566 2578 scope.go:117] "RemoveContainer" containerID="cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" Sep 09 09:49:24.305800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305581 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerDied","Data":"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e"} Sep 09 09:49:24.305800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.305604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c27dda31-10e4-45c2-9f52-1f1efe8fb45c","Type":"ContainerDied","Data":"51405c36e3067d8dd6bb82ffba9569979d24aeb55d1c6e029432fd8736e1feaa"} Sep 09 09:49:24.313548 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.313531 2578 scope.go:117] "RemoveContainer" containerID="a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" Sep 09 09:49:24.320509 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.320492 2578 scope.go:117] "RemoveContainer" containerID="ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" Sep 09 09:49:24.325517 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.325488 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 09:49:24.327642 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.327626 2578 scope.go:117] "RemoveContainer" containerID="40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" Sep 09 09:49:24.330167 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.330147 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 09:49:24.334960 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.334942 2578 scope.go:117] "RemoveContainer" containerID="f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" Sep 09 09:49:24.341637 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.341617 2578 scope.go:117] "RemoveContainer" containerID="a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" Sep 09 09:49:24.348438 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.348424 2578 scope.go:117] "RemoveContainer" containerID="609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80" Sep 09 09:49:24.355199 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.355178 2578 scope.go:117] "RemoveContainer" containerID="cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" Sep 09 09:49:24.355432 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:49:24.355416 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": container with ID starting with cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861 not found: ID does not exist" containerID="cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" Sep 09 09:49:24.355495 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.355443 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861"} err="failed to get container status \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": rpc error: code = NotFound desc = could not find container \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": container with ID starting with cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861 not found: ID does not exist" Sep 09 09:49:24.355495 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.355459 2578 scope.go:117] "RemoveContainer" containerID="a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" Sep 09 09:49:24.355687 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:49:24.355668 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": container with ID starting with a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd not found: ID does not exist" containerID="a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" Sep 09 09:49:24.355736 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.355694 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd"} err="failed to get container status \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": rpc error: code = NotFound desc = could not find container \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": container with ID starting with a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd not found: ID does not exist" Sep 09 09:49:24.355736 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.355712 2578 scope.go:117] "RemoveContainer" containerID="ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" Sep 09 09:49:24.355960 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:49:24.355944 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": container with ID starting with ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54 not found: ID does not exist" containerID="ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" Sep 09 09:49:24.356014 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.355963 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54"} err="failed to get container status \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": rpc error: code = NotFound desc = could not find container \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": container with ID starting with ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54 not found: ID does not exist" Sep 09 09:49:24.356014 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.355976 2578 scope.go:117] "RemoveContainer" containerID="40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" Sep 09 09:49:24.356231 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:49:24.356216 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": container with ID starting with 40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6 not found: ID does not exist" containerID="40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" Sep 09 09:49:24.356274 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.356236 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6"} err="failed to get container status \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": rpc error: code = NotFound desc = could not find container \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": container with ID starting with 40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6 not found: ID does not exist" Sep 09 09:49:24.356274 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.356251 2578 scope.go:117] "RemoveContainer" containerID="f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" Sep 09 09:49:24.356466 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:49:24.356452 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": container with ID starting with f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af not found: ID does not exist" containerID="f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" Sep 09 09:49:24.356511 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.356469 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af"} err="failed to get container status \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": rpc error: code = NotFound desc = could not find container \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": container with ID starting with f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af not found: ID does not exist" Sep 09 09:49:24.356511 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.356480 2578 scope.go:117] "RemoveContainer" containerID="a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" Sep 09 09:49:24.356683 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:49:24.356669 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": container with ID starting with a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e not found: ID does not exist" containerID="a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" Sep 09 09:49:24.356718 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.356690 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e"} err="failed to get container status \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": rpc error: code = NotFound desc = could not find container \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": container with ID starting with a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e not found: ID does not exist" Sep 09 09:49:24.356718 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.356705 2578 scope.go:117] "RemoveContainer" containerID="609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80" Sep 09 09:49:24.356970 ip-10-0-135-209 kubenswrapper[2578]: E0909 09:49:24.356952 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": container with ID starting with 609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80 not found: ID does not exist" containerID="609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80" Sep 09 09:49:24.357057 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.356970 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80"} err="failed to get container status \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": rpc error: code = NotFound desc = could not find container \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": container with ID starting with 609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80 not found: ID does not exist" Sep 09 09:49:24.357057 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.356981 2578 scope.go:117] "RemoveContainer" containerID="cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" Sep 09 09:49:24.357215 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.357200 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861"} err="failed to get container status \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": rpc error: code = NotFound desc = could not find container \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": container with ID starting with cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861 not found: ID does not exist" Sep 09 09:49:24.357259 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.357216 2578 scope.go:117] "RemoveContainer" containerID="a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" Sep 09 09:49:24.357424 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.357407 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd"} err="failed to get container status \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": rpc error: code = NotFound desc = could not find container \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": container with ID starting with a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd not found: ID does not exist" Sep 09 09:49:24.357461 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.357424 2578 scope.go:117] "RemoveContainer" containerID="ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" Sep 09 09:49:24.357639 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.357619 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54"} err="failed to get container status \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": rpc error: code = NotFound desc = could not find container \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": container with ID starting with ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54 not found: ID does not exist" Sep 09 09:49:24.357639 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.357639 2578 scope.go:117] "RemoveContainer" containerID="40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" Sep 09 09:49:24.357851 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.357837 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6"} err="failed to get container status \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": rpc error: code = NotFound desc = could not find container \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": container with ID starting with 40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6 not found: ID does not exist" Sep 09 09:49:24.357896 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.357853 2578 scope.go:117] "RemoveContainer" containerID="f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" Sep 09 09:49:24.358153 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.358130 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af"} err="failed to get container status \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": rpc error: code = NotFound desc = could not find container \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": container with ID starting with f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af not found: ID does not exist" Sep 09 09:49:24.358246 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.358155 2578 scope.go:117] "RemoveContainer" containerID="a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" Sep 09 09:49:24.358480 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.358455 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e"} err="failed to get container status \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": rpc error: code = NotFound desc = could not find container \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": container with ID starting with a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e not found: ID does not exist" Sep 09 09:49:24.358480 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.358480 2578 scope.go:117] "RemoveContainer" containerID="609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80" Sep 09 09:49:24.358800 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.358776 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80"} err="failed to get container status \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": rpc error: code = NotFound desc = could not find container \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": container with ID starting with 609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80 not found: ID does not exist" Sep 09 09:49:24.358883 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.358801 2578 scope.go:117] "RemoveContainer" containerID="cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" Sep 09 09:49:24.359101 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.359078 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861"} err="failed to get container status \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": rpc error: code = NotFound desc = could not find container \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": container with ID starting with cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861 not found: ID does not exist" Sep 09 09:49:24.359156 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.359103 2578 scope.go:117] "RemoveContainer" containerID="a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" Sep 09 09:49:24.359399 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.359377 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd"} err="failed to get container status \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": rpc error: code = NotFound desc = could not find container \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": container with ID starting with a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd not found: ID does not exist" Sep 09 09:49:24.359468 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.359399 2578 scope.go:117] "RemoveContainer" containerID="ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" Sep 09 09:49:24.359657 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.359639 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54"} err="failed to get container status \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": rpc error: code = NotFound desc = could not find container \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": container with ID starting with ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54 not found: ID does not exist" Sep 09 09:49:24.359657 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.359657 2578 scope.go:117] "RemoveContainer" containerID="40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" Sep 09 09:49:24.359906 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.359891 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6"} err="failed to get container status \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": rpc error: code = NotFound desc = could not find container \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": container with ID starting with 40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6 not found: ID does not exist" Sep 09 09:49:24.359974 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.359906 2578 scope.go:117] "RemoveContainer" containerID="f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" Sep 09 09:49:24.360067 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360048 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 09:49:24.360144 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360128 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af"} err="failed to get container status \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": rpc error: code = NotFound desc = could not find container \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": container with ID starting with f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af not found: ID does not exist" Sep 09 09:49:24.360199 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360145 2578 scope.go:117] "RemoveContainer" containerID="a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" Sep 09 09:49:24.360315 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360300 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ac9d48-0661-4391-96c7-63c9a19c3a0c" containerName="console" Sep 09 09:49:24.360315 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360315 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ac9d48-0661-4391-96c7-63c9a19c3a0c" containerName="console" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360325 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360331 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360338 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="prometheus" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360343 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="prometheus" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360351 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="prom-label-proxy" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360358 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="prom-label-proxy" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360368 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="config-reloader" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360376 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="config-reloader" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360388 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="init-config-reloader" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360395 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="init-config-reloader" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360407 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="init-config-reloader" Sep 09 09:49:24.360414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360389 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e"} err="failed to get container status \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": rpc error: code = NotFound desc = could not find container \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": container with ID starting with a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e not found: ID does not exist" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360430 2578 scope.go:117] "RemoveContainer" containerID="609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360412 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="init-config-reloader" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360496 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy-web" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360504 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy-web" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360510 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy-web" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360516 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy-web" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360524 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="config-reloader" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360533 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="config-reloader" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360541 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy-thanos" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360546 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy-thanos" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360561 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="thanos-sidecar" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360569 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="thanos-sidecar" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360580 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy-metric" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360587 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy-metric" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360595 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360603 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360612 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="alertmanager" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360620 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="alertmanager" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360656 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80"} err="failed to get container status \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": rpc error: code = NotFound desc = could not find container \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": container with ID starting with 609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80 not found: ID does not exist" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360669 2578 scope.go:117] "RemoveContainer" containerID="cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360682 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360693 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ac9d48-0661-4391-96c7-63c9a19c3a0c" containerName="console" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360703 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="alertmanager" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360708 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="prom-label-proxy" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360714 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="config-reloader" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360720 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="prometheus" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360724 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy-web" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360730 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy-web" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360734 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360739 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="kube-rbac-proxy-thanos" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360744 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="config-reloader" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360748 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab3e713-642a-47ec-86bb-de7fef9c866d" containerName="kube-rbac-proxy-metric" Sep 09 09:49:24.360794 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360752 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" containerName="thanos-sidecar" Sep 09 09:49:24.361851 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360900 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861"} err="failed to get container status \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": rpc error: code = NotFound desc = could not find container \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": container with ID starting with cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861 not found: ID does not exist" Sep 09 09:49:24.361851 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.360911 2578 scope.go:117] "RemoveContainer" containerID="a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" Sep 09 09:49:24.361851 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.361194 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd"} err="failed to get container status \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": rpc error: code = NotFound desc = could not find container \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": container with ID starting with a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd not found: ID does not exist" Sep 09 09:49:24.361851 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.361216 2578 scope.go:117] "RemoveContainer" containerID="ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" Sep 09 09:49:24.361851 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.361448 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54"} err="failed to get container status \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": rpc error: code = NotFound desc = could not find container \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": container with ID starting with ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54 not found: ID does not exist" Sep 09 09:49:24.361851 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.361463 2578 scope.go:117] "RemoveContainer" containerID="40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" Sep 09 09:49:24.361851 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.361673 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6"} err="failed to get container status \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": rpc error: code = NotFound desc = could not find container \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": container with ID starting with 40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6 not found: ID does not exist" Sep 09 09:49:24.361851 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.361688 2578 scope.go:117] "RemoveContainer" containerID="f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" Sep 09 09:49:24.362177 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.361910 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af"} err="failed to get container status \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": rpc error: code = NotFound desc = could not find container \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": container with ID starting with f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af not found: ID does not exist" Sep 09 09:49:24.362177 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.361945 2578 scope.go:117] "RemoveContainer" containerID="a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" Sep 09 09:49:24.362177 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.362124 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e"} err="failed to get container status \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": rpc error: code = NotFound desc = could not find container \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": container with ID starting with a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e not found: ID does not exist" Sep 09 09:49:24.362177 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.362136 2578 scope.go:117] "RemoveContainer" containerID="609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80" Sep 09 09:49:24.362348 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.362332 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80"} err="failed to get container status \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": rpc error: code = NotFound desc = could not find container \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": container with ID starting with 609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80 not found: ID does not exist" Sep 09 09:49:24.362386 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.362348 2578 scope.go:117] "RemoveContainer" containerID="cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" Sep 09 09:49:24.362519 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.362500 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861"} err="failed to get container status \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": rpc error: code = NotFound desc = could not find container \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": container with ID starting with cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861 not found: ID does not exist" Sep 09 09:49:24.362519 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.362515 2578 scope.go:117] "RemoveContainer" containerID="a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" Sep 09 09:49:24.362751 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.362732 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd"} err="failed to get container status \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": rpc error: code = NotFound desc = could not find container \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": container with ID starting with a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd not found: ID does not exist" Sep 09 09:49:24.362828 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.362751 2578 scope.go:117] "RemoveContainer" containerID="ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" Sep 09 09:49:24.363078 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363058 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54"} err="failed to get container status \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": rpc error: code = NotFound desc = could not find container \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": container with ID starting with ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54 not found: ID does not exist" Sep 09 09:49:24.363078 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363078 2578 scope.go:117] "RemoveContainer" containerID="40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" Sep 09 09:49:24.363317 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363301 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6"} err="failed to get container status \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": rpc error: code = NotFound desc = could not find container \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": container with ID starting with 40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6 not found: ID does not exist" Sep 09 09:49:24.363360 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363318 2578 scope.go:117] "RemoveContainer" containerID="f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" Sep 09 09:49:24.363524 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363506 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af"} err="failed to get container status \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": rpc error: code = NotFound desc = could not find container \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": container with ID starting with f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af not found: ID does not exist" Sep 09 09:49:24.363593 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363526 2578 scope.go:117] "RemoveContainer" containerID="a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" Sep 09 09:49:24.363742 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363722 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e"} err="failed to get container status \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": rpc error: code = NotFound desc = could not find container \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": container with ID starting with a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e not found: ID does not exist" Sep 09 09:49:24.363742 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363738 2578 scope.go:117] "RemoveContainer" containerID="609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80" Sep 09 09:49:24.363965 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363951 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80"} err="failed to get container status \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": rpc error: code = NotFound desc = could not find container \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": container with ID starting with 609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80 not found: ID does not exist" Sep 09 09:49:24.363965 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.363965 2578 scope.go:117] "RemoveContainer" containerID="cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861" Sep 09 09:49:24.364165 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.364141 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861"} err="failed to get container status \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": rpc error: code = NotFound desc = could not find container \"cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861\": container with ID starting with cdf9fda73d87f64c325b64eb42d965c7f1e3e489740161e9a570bedf74b40861 not found: ID does not exist" Sep 09 09:49:24.364241 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.364169 2578 scope.go:117] "RemoveContainer" containerID="a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd" Sep 09 09:49:24.364421 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.364405 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd"} err="failed to get container status \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": rpc error: code = NotFound desc = could not find container \"a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd\": container with ID starting with a5e85c61c605a75a9bdd3fdc4e09387acb7a89e2823d0f9e98e301e98656d1fd not found: ID does not exist" Sep 09 09:49:24.364465 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.364421 2578 scope.go:117] "RemoveContainer" containerID="ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54" Sep 09 09:49:24.364641 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.364625 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54"} err="failed to get container status \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": rpc error: code = NotFound desc = could not find container \"ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54\": container with ID starting with ffe8525fa6a89caff2178148fd15b09558ec0116845ea62e25cd81f79a484a54 not found: ID does not exist" Sep 09 09:49:24.364683 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.364642 2578 scope.go:117] "RemoveContainer" containerID="40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6" Sep 09 09:49:24.364861 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.364843 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6"} err="failed to get container status \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": rpc error: code = NotFound desc = could not find container \"40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6\": container with ID starting with 40305c90e3e100a5d9417f67008f0d29ce8d98853ba41fb4f6efe3178390fcc6 not found: ID does not exist" Sep 09 09:49:24.364943 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.364862 2578 scope.go:117] "RemoveContainer" containerID="f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af" Sep 09 09:49:24.365117 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.365101 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af"} err="failed to get container status \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": rpc error: code = NotFound desc = could not find container \"f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af\": container with ID starting with f2fd9916b1888202877377e02af897f2624bf584728105c1a3e1b975837af9af not found: ID does not exist" Sep 09 09:49:24.365159 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.365118 2578 scope.go:117] "RemoveContainer" containerID="a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e" Sep 09 09:49:24.365317 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.365303 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e"} err="failed to get container status \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": rpc error: code = NotFound desc = could not find container \"a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e\": container with ID starting with a0237d5450d3d592effc78ab84412b7437d5e6621e6b3b6d2c1e2388b2c5b33e not found: ID does not exist" Sep 09 09:49:24.365317 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.365316 2578 scope.go:117] "RemoveContainer" containerID="609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80" Sep 09 09:49:24.365986 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.365970 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80"} err="failed to get container status \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": rpc error: code = NotFound desc = could not find container \"609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80\": container with ID starting with 609412c533b29386886d62b5bdef63e22f4cac175a1fed331c3a0323ee91ed80 not found: ID does not exist" Sep 09 09:49:24.366035 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.366007 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.369509 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.369492 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 09:49:24.370115 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.370102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 09:49:24.372448 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.372427 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 09:49:24.372663 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.372648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 09:49:24.372789 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.372771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w46qx\"" Sep 09 09:49:24.372858 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.372844 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 09:49:24.372913 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.372904 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 09:49:24.372982 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.372910 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 09:49:24.373112 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.373097 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 09:49:24.373219 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.373202 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 09:49:24.373279 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.373214 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 09:49:24.373279 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.373271 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 09:49:24.373379 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.373210 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 09:49:24.373379 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.373271 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3qvvk9d5tftat\"" Sep 09 09:49:24.373443 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.373381 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 09:49:24.386292 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.386272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 09:49:24.390539 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.390524 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 09:49:24.397029 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.397007 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 09:49:24.419738 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.419836 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.419836 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419770 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.419836 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.419836 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420052 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420052 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420052 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420052 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420052 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.419990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420052 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-config\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4528b79-a255-42ea-a2f8-c511fa2f57f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4528b79-a255-42ea-a2f8-c511fa2f57f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.420371 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.420328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl248\" (UniqueName: \"kubernetes.io/projected/a4528b79-a255-42ea-a2f8-c511fa2f57f6-kube-api-access-fl248\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.520915 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.520878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.520915 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.520932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.520949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-config\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.520966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.520983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.520999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4528b79-a255-42ea-a2f8-c511fa2f57f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4528b79-a255-42ea-a2f8-c511fa2f57f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl248\" (UniqueName: \"kubernetes.io/projected/a4528b79-a255-42ea-a2f8-c511fa2f57f6-kube-api-access-fl248\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.521184 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.522540 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.522540 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.522540 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.522540 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.522540 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.522540 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.522540 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521763 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.522540 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.521842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.523355 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.522611 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.523451 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.523427 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.524167 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.524137 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.524414 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.524367 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.524585 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.524543 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.524957 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.524934 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4528b79-a255-42ea-a2f8-c511fa2f57f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.525051 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.525025 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.525185 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.525163 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.526123 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.526080 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.526267 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.526236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4528b79-a255-42ea-a2f8-c511fa2f57f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.526383 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.526327 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.526657 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.526634 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.526874 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.526856 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-config\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.526961 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.526911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.527301 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.527286 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.527613 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.527593 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4528b79-a255-42ea-a2f8-c511fa2f57f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.528176 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.528148 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4528b79-a255-42ea-a2f8-c511fa2f57f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.530865 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.530841 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl248\" (UniqueName: \"kubernetes.io/projected/a4528b79-a255-42ea-a2f8-c511fa2f57f6-kube-api-access-fl248\") pod \"prometheus-k8s-0\" (UID: \"a4528b79-a255-42ea-a2f8-c511fa2f57f6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.674736 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.674696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:49:24.976272 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:24.976186 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 09:49:24.979882 ip-10-0-135-209 kubenswrapper[2578]: W0909 09:49:24.979853 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4528b79_a255_42ea_a2f8_c511fa2f57f6.slice/crio-f51ed84a9dfcf3e47519a46ef2b78ebaf8083ff8a9028f6e52691f224a6c4913 WatchSource:0}: Error finding container f51ed84a9dfcf3e47519a46ef2b78ebaf8083ff8a9028f6e52691f224a6c4913: Status 404 returned error can't find the container with id f51ed84a9dfcf3e47519a46ef2b78ebaf8083ff8a9028f6e52691f224a6c4913 Sep 09 09:49:25.312091 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:25.312009 2578 generic.go:356] "Generic (PLEG): container finished" podID="a4528b79-a255-42ea-a2f8-c511fa2f57f6" containerID="60858e01def22ab8aa0166a0c19323a5217ceef57bfc235ed23c50a00ff5fa35" exitCode=0 Sep 09 09:49:25.312091 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:25.312051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4528b79-a255-42ea-a2f8-c511fa2f57f6","Type":"ContainerDied","Data":"60858e01def22ab8aa0166a0c19323a5217ceef57bfc235ed23c50a00ff5fa35"} Sep 09 09:49:25.312270 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:25.312098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4528b79-a255-42ea-a2f8-c511fa2f57f6","Type":"ContainerStarted","Data":"f51ed84a9dfcf3e47519a46ef2b78ebaf8083ff8a9028f6e52691f224a6c4913"} Sep 09 09:49:25.829489 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:25.829408 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c27dda31-10e4-45c2-9f52-1f1efe8fb45c" path="/var/lib/kubelet/pods/c27dda31-10e4-45c2-9f52-1f1efe8fb45c/volumes" Sep 09 09:49:26.320009 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:26.319972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4528b79-a255-42ea-a2f8-c511fa2f57f6","Type":"ContainerStarted","Data":"a6f513c18d9b9ecaf43c97b90085a66ed85061623cb3d8ff40e1ce5f4260b8ea"} Sep 09 09:49:26.320186 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:26.320054 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4528b79-a255-42ea-a2f8-c511fa2f57f6","Type":"ContainerStarted","Data":"d8eb2257d9f079d7924c363094daf044d1bb30dd7af0d3a55bd126bb04cea50a"} Sep 09 09:49:26.320186 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:26.320099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4528b79-a255-42ea-a2f8-c511fa2f57f6","Type":"ContainerStarted","Data":"1f8c9f80e1cac0b88bc2d8f8304e490474468fdf186f83b7daf928b88b7f9e39"} Sep 09 09:49:26.320186 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:26.320136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4528b79-a255-42ea-a2f8-c511fa2f57f6","Type":"ContainerStarted","Data":"dd359aa0e216ad380f516cbd43afabf91aa4d18b06e68fb72482b1cc811475ee"} Sep 09 09:49:26.320186 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:26.320178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4528b79-a255-42ea-a2f8-c511fa2f57f6","Type":"ContainerStarted","Data":"d6f1154f5766660141cc86be2329cde318994bde53460b3bebd3d29bed17800b"} Sep 09 09:49:26.320312 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:26.320220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4528b79-a255-42ea-a2f8-c511fa2f57f6","Type":"ContainerStarted","Data":"ca3efbfd209bef86a40e98b9563ce40e108c67688180880fd2056039b6c50390"} Sep 09 09:49:26.360192 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:26.360122 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.343804358 podStartE2EDuration="2.360102385s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.298027ms" isStatefulPod=false podCreationTimestamp="2026-09-09 09:49:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 09:49:26.359033855 +0000 UTC m=+391.019587007" watchObservedRunningTime="2026-09-09 09:49:26.360102385 +0000 UTC m=+391.020655537" Sep 09 09:49:29.675880 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:49:29.675840 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:50:24.675881 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:50:24.675782 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:50:24.692827 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:50:24.692796 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:50:25.562106 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:50:25.562077 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 09:52:55.777841 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:52:55.777814 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 09:52:55.779720 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:52:55.779696 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 09:54:55.809150 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:54:55.809116 2578 scope.go:117] "RemoveContainer" containerID="fee592813b60580af1c41575298c60f1afba79d33f1f24fd187d9584fb229b51" Sep 09 09:54:55.816939 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:54:55.816890 2578 scope.go:117] "RemoveContainer" containerID="db2bf82b78e8dc3b5bf7614ad68105c4d31131709de390bb0a642309c7028a19" Sep 09 09:54:55.823711 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:54:55.823695 2578 scope.go:117] "RemoveContainer" containerID="936c7c1771cbd98449407608cdb0e38a398a04516b798868d18bcac1eac4dc9f" Sep 09 09:54:55.831267 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:54:55.831248 2578 scope.go:117] "RemoveContainer" containerID="895b6a9de12e95c8d750ce42ea8a704da7ffad82243f559492a1bf3f9feb5464" Sep 09 09:54:55.838660 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:54:55.838643 2578 scope.go:117] "RemoveContainer" containerID="ffc03a290c26240c8de4a99d719b3be1b2a052b5a5cc6f1eaa95e5fc3b0c41de" Sep 09 09:54:55.845601 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:54:55.845581 2578 scope.go:117] "RemoveContainer" containerID="537c7735d6d6c906c3981f195e0b9bbd4dd0fe9c02a9f78143db167b9c784c78" Sep 09 09:54:55.852232 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:54:55.852213 2578 scope.go:117] "RemoveContainer" containerID="bafed435b1a0eae869c4c227320049bd2959133710300f2107a83257a0393110" Sep 09 09:57:55.801734 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:57:55.801700 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 09:57:55.802213 ip-10-0-135-209 kubenswrapper[2578]: I0909 09:57:55.801854 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:02:55.827283 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:02:55.827193 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:02:55.828035 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:02:55.827997 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:07:55.859786 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:07:55.859753 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:07:55.861440 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:07:55.861419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:12:55.881285 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:12:55.881258 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:12:55.884493 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:12:55.884466 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:17:55.902262 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:17:55.902237 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:17:55.906738 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:17:55.906718 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:18:17.486134 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:17.486095 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bzgh5_7dfb4a32-9282-4df8-b36e-0979d8ae92bf/global-pull-secret-syncer/0.log" Sep 09 10:18:17.639553 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:17.639518 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t6cps_94844c18-18bb-41ff-84f8-0d9c5618b6ec/konnectivity-agent/0.log" Sep 09 10:18:17.697611 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:17.697585 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-209.ec2.internal_bd219ac27246030f2e9ce6036a40244e/haproxy/0.log" Sep 09 10:18:21.458194 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:21.458112 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-6fvcs_d4817587-f391-4998-9183-54087b2cbacc/kube-state-metrics/0.log" Sep 09 10:18:21.477089 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:21.477060 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-6fvcs_d4817587-f391-4998-9183-54087b2cbacc/kube-rbac-proxy-main/0.log" Sep 09 10:18:21.501166 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:21.501140 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-6fvcs_d4817587-f391-4998-9183-54087b2cbacc/kube-rbac-proxy-self/0.log" Sep 09 10:18:21.617851 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:21.617827 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnmll_31fb153f-fe00-4e0d-9e1b-07e2bcd06276/node-exporter/0.log" Sep 09 10:18:21.641643 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:21.641624 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnmll_31fb153f-fe00-4e0d-9e1b-07e2bcd06276/kube-rbac-proxy/0.log" Sep 09 10:18:21.664415 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:21.664400 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnmll_31fb153f-fe00-4e0d-9e1b-07e2bcd06276/init-textfile/0.log" Sep 09 10:18:21.963499 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:21.963473 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4528b79-a255-42ea-a2f8-c511fa2f57f6/prometheus/0.log" Sep 09 10:18:21.988803 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:21.988782 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4528b79-a255-42ea-a2f8-c511fa2f57f6/config-reloader/0.log" Sep 09 10:18:22.010425 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:22.010403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4528b79-a255-42ea-a2f8-c511fa2f57f6/thanos-sidecar/0.log" Sep 09 10:18:22.034258 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:22.034234 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4528b79-a255-42ea-a2f8-c511fa2f57f6/kube-rbac-proxy-web/0.log" Sep 09 10:18:22.062049 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:22.062027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4528b79-a255-42ea-a2f8-c511fa2f57f6/kube-rbac-proxy/0.log" Sep 09 10:18:22.085392 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:22.085365 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4528b79-a255-42ea-a2f8-c511fa2f57f6/kube-rbac-proxy-thanos/0.log" Sep 09 10:18:22.108598 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:22.108583 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4528b79-a255-42ea-a2f8-c511fa2f57f6/init-config-reloader/0.log" Sep 09 10:18:24.186384 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:24.186359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/1.log" Sep 09 10:18:24.195860 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:24.195825 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-2kz7l_18d954dd-3565-4bdb-8fd3-04f55fd4c69c/console-operator/2.log" Sep 09 10:18:24.985791 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:24.985756 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j"] Sep 09 10:18:24.989029 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:24.989014 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:24.993092 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:24.993069 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p2zm4\"/\"default-dockercfg-m6xl7\"" Sep 09 10:18:24.993836 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:24.993817 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2zm4\"/\"openshift-service-ca.crt\"" Sep 09 10:18:24.993956 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:24.993858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2zm4\"/\"kube-root-ca.crt\"" Sep 09 10:18:25.009511 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.009486 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j"] Sep 09 10:18:25.103941 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.103897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-proc\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.104138 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.103951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-podres\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.104138 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.103983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-sys\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.104138 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.104007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-lib-modules\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.104138 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.104032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qmbx\" (UniqueName: \"kubernetes.io/projected/b6159f72-7ab8-4d7e-826b-c23e8609a1db-kube-api-access-7qmbx\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.204690 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.204657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-proc\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.205123 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.204694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-podres\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.205123 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.204725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-sys\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.205123 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.204739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-lib-modules\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.205123 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.204760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qmbx\" (UniqueName: \"kubernetes.io/projected/b6159f72-7ab8-4d7e-826b-c23e8609a1db-kube-api-access-7qmbx\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.205123 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.204772 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-proc\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.205123 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.204831 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-sys\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.205123 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.204884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-lib-modules\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.205123 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.204909 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6159f72-7ab8-4d7e-826b-c23e8609a1db-podres\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.213721 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.213702 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qmbx\" (UniqueName: \"kubernetes.io/projected/b6159f72-7ab8-4d7e-826b-c23e8609a1db-kube-api-access-7qmbx\") pod \"perf-node-gather-daemonset-x4h4j\" (UID: \"b6159f72-7ab8-4d7e-826b-c23e8609a1db\") " pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.299037 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.298947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:25.573389 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:25.573368 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j"] Sep 09 10:18:25.576090 ip-10-0-135-209 kubenswrapper[2578]: W0909 10:18:25.576061 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb6159f72_7ab8_4d7e_826b_c23e8609a1db.slice/crio-d87796e0d88e9810de66ab3a5113200ba43d73a0cf072cba4c4177a3b56d59f3 WatchSource:0}: Error finding container d87796e0d88e9810de66ab3a5113200ba43d73a0cf072cba4c4177a3b56d59f3: Status 404 returned error can't find the container with id d87796e0d88e9810de66ab3a5113200ba43d73a0cf072cba4c4177a3b56d59f3 Sep 09 10:18:26.383152 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:26.383122 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kd79w_c1dc69d3-d3b8-4c2f-a087-d9921e7610ad/dns/0.log" Sep 09 10:18:26.413082 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:26.413047 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" event={"ID":"b6159f72-7ab8-4d7e-826b-c23e8609a1db","Type":"ContainerStarted","Data":"d8df306e36e21fe293559356ba9b4819f6d8cacdad34cd17565bd034bfe8d750"} Sep 09 10:18:26.413205 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:26.413141 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:26.413205 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:26.413170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" event={"ID":"b6159f72-7ab8-4d7e-826b-c23e8609a1db","Type":"ContainerStarted","Data":"d87796e0d88e9810de66ab3a5113200ba43d73a0cf072cba4c4177a3b56d59f3"} Sep 09 10:18:26.428239 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:26.428212 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kd79w_c1dc69d3-d3b8-4c2f-a087-d9921e7610ad/kube-rbac-proxy/0.log" Sep 09 10:18:26.447518 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:26.447471 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" podStartSLOduration=2.447457852 podStartE2EDuration="2.447457852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 10:18:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 10:18:26.445278016 +0000 UTC m=+2131.105831170" watchObservedRunningTime="2026-09-09 10:18:26.447457852 +0000 UTC m=+2131.108011043" Sep 09 10:18:26.583502 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:26.583479 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r59lh_9a4c2598-427a-4d10-b6be-7a7f83add348/dns-node-resolver/0.log" Sep 09 10:18:27.058322 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:27.058296 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lp5bd_b2ad8ffb-35c6-46ee-b453-eba47783169f/node-ca/0.log" Sep 09 10:18:28.095023 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:28.094988 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kcgmg_a724e969-f4a6-4ce5-9924-48e77fe7fa43/serve-healthcheck-canary/0.log" Sep 09 10:18:28.582028 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:28.581998 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f7778_9b110458-849e-46e1-a215-f94e004af7d0/kube-rbac-proxy/0.log" Sep 09 10:18:28.601337 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:28.601306 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f7778_9b110458-849e-46e1-a215-f94e004af7d0/exporter/0.log" Sep 09 10:18:28.626124 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:28.626083 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f7778_9b110458-849e-46e1-a215-f94e004af7d0/extractor/0.log" Sep 09 10:18:32.426335 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:32.426309 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p2zm4/perf-node-gather-daemonset-x4h4j" Sep 09 10:18:32.715863 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:32.715770 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b7wt2_a68c1880-fe46-4118-afe5-1a768de4aad8/migrator/0.log" Sep 09 10:18:32.733742 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:32.733721 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b7wt2_a68c1880-fe46-4118-afe5-1a768de4aad8/graceful-termination/0.log" Sep 09 10:18:33.928852 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:33.928767 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9d7r2_4c6508ea-5097-4929-a283-92337e4bab62/kube-multus/0.log" Sep 09 10:18:33.954007 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:33.953977 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-79hbs_fd5747a3-029a-4f4a-9290-4ae6ca6537d5/kube-multus-additional-cni-plugins/0.log" Sep 09 10:18:33.972208 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:33.972181 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-79hbs_fd5747a3-029a-4f4a-9290-4ae6ca6537d5/egress-router-binary-copy/0.log" Sep 09 10:18:33.991869 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:33.991841 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-79hbs_fd5747a3-029a-4f4a-9290-4ae6ca6537d5/cni-plugins/0.log" Sep 09 10:18:34.016126 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:34.016102 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-79hbs_fd5747a3-029a-4f4a-9290-4ae6ca6537d5/bond-cni-plugin/0.log" Sep 09 10:18:34.039891 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:34.039865 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-79hbs_fd5747a3-029a-4f4a-9290-4ae6ca6537d5/routeoverride-cni/0.log" Sep 09 10:18:34.069194 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:34.069172 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-79hbs_fd5747a3-029a-4f4a-9290-4ae6ca6537d5/whereabouts-cni-bincopy/0.log" Sep 09 10:18:34.093240 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:34.093213 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-79hbs_fd5747a3-029a-4f4a-9290-4ae6ca6537d5/whereabouts-cni/0.log" Sep 09 10:18:34.513818 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:34.513719 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-54f24_6094a86f-2794-4ea2-8be5-3c8cd76fb69a/network-metrics-daemon/0.log" Sep 09 10:18:34.531344 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:34.531318 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-54f24_6094a86f-2794-4ea2-8be5-3c8cd76fb69a/kube-rbac-proxy/0.log" Sep 09 10:18:35.483074 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:35.483040 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4x99_947dc36a-67e2-48d1-bc1f-673e803ecb24/ovn-controller/0.log" Sep 09 10:18:35.497408 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:35.497387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4x99_947dc36a-67e2-48d1-bc1f-673e803ecb24/ovn-acl-logging/0.log" Sep 09 10:18:35.524265 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:35.524236 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4x99_947dc36a-67e2-48d1-bc1f-673e803ecb24/kube-rbac-proxy-node/0.log" Sep 09 10:18:35.548091 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:35.548067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4x99_947dc36a-67e2-48d1-bc1f-673e803ecb24/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 10:18:35.564764 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:35.564746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4x99_947dc36a-67e2-48d1-bc1f-673e803ecb24/northd/0.log" Sep 09 10:18:35.585000 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:35.584946 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4x99_947dc36a-67e2-48d1-bc1f-673e803ecb24/nbdb/0.log" Sep 09 10:18:35.604414 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:35.604387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4x99_947dc36a-67e2-48d1-bc1f-673e803ecb24/sbdb/0.log" Sep 09 10:18:35.654255 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:35.654229 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4x99_947dc36a-67e2-48d1-bc1f-673e803ecb24/ovnkube-controller/0.log" Sep 09 10:18:36.799908 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:36.799876 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-695dm_082d0388-4d45-4560-9a2a-d7da02a5fc1e/network-check-target-container/0.log" Sep 09 10:18:37.781366 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:37.781333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9tqgw_14150818-ac39-4899-b393-13604e146532/iptables-alerter/0.log" Sep 09 10:18:38.480473 ip-10-0-135-209 kubenswrapper[2578]: I0909 10:18:38.480448 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-wgns5_b683f88a-91f3-4b0d-8eca-01e01b15c2e6/tuned/0.log"