Sep 09 20:45:25.273261 ip-10-0-132-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 20:45:25.273277 ip-10-0-132-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 20:45:25.273287 ip-10-0-132-118 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 20:45:25.273720 ip-10-0-132-118 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 20:45:34.835344 ip-10-0-132-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Sep 09 20:45:34.835358 ip-10-0-132-118 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 38961c55109f4e529c26bfa917001d85 -- Sep 09 20:47:15.707839 ip-10-0-132-118 systemd[1]: Starting Kubernetes Kubelet... Sep 09 20:47:16.142595 ip-10-0-132-118 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:47:16.142595 ip-10-0-132-118 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 20:47:16.142595 ip-10-0-132-118 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:47:16.142595 ip-10-0-132-118 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 20:47:16.142595 ip-10-0-132-118 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:47:16.145094 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.145000 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 20:47:16.153082 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153063 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:47:16.153082 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153079 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:47:16.153082 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153084 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:47:16.153082 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153087 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153093 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153097 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153101 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153107 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153112 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153115 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153119 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153124 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153128 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153131 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153136 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153140 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153144 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153148 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153152 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153156 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153160 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153164 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153169 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:47:16.153320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153173 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153185 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153189 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153193 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153197 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153202 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153206 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153210 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153215 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153219 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153223 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153227 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153231 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153246 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153253 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153259 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153263 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153268 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153272 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153278 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:47:16.154151 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153282 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153290 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153296 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153300 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153305 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153309 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153313 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153317 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153321 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153325 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153330 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153334 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153338 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153343 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153347 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153352 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153357 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153361 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153366 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:47:16.154674 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153371 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153375 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153379 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153383 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153387 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153392 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153396 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153401 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153406 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153412 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153416 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153421 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153425 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153429 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153434 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153438 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153443 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153448 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153452 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153456 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:47:16.155193 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153460 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153467 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153471 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153475 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153480 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153484 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153488 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153493 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153499 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153505 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153510 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153515 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153520 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153539 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153544 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153548 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:47:16.155701 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.153553 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:47:16.156725 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156708 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:47:16.156725 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156724 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:47:16.156725 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156729 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156734 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156738 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156742 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156747 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156751 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156755 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156758 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156762 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156766 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156770 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156774 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156778 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156782 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156788 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156794 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156798 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156803 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156807 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:47:16.156912 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156811 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156814 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156818 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156822 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156826 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156830 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156834 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156840 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156844 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156848 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156853 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156857 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156861 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156865 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156869 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156875 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156879 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156885 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156889 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156893 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:47:16.157738 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156897 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156901 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156905 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156909 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156913 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156917 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156921 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156925 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156929 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156933 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156937 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156942 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156947 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156951 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156955 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156960 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156964 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156968 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156972 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156976 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:47:16.158636 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156984 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156990 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.156996 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157000 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157004 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157009 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157013 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157018 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157023 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157027 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157032 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157036 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157040 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157045 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157049 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157053 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157057 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157061 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157065 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157069 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:47:16.159486 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157073 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157077 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157081 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157086 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157090 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157094 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157098 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157102 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157106 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157110 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157115 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157119 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157123 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157127 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157131 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157135 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157140 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157144 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157776 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157785 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:47:16.160197 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157790 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157794 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157800 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157804 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157808 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157813 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157817 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157822 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157826 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157830 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157834 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157838 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157842 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157846 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157850 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157855 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157859 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157863 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157867 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157872 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:47:16.160742 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157876 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157880 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157885 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157889 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157893 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157897 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157901 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157906 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157910 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157914 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157918 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157922 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157926 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157930 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157934 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157939 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157943 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157948 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157952 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:47:16.161286 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157956 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157960 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157965 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157969 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157973 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157979 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157983 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157988 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157992 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.157996 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158002 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158007 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158012 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158017 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158020 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158024 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158029 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158033 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158037 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158041 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:47:16.161798 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158047 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158051 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158056 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158060 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158064 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158068 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158072 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158076 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158080 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158085 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158089 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158093 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158098 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158102 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158108 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158114 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158119 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158123 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158127 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:47:16.162407 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158133 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158138 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158141 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158145 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158150 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158153 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158158 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158162 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158166 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158170 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158174 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158178 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158183 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158191 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158196 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158201 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158207 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158211 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.158216 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158329 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158383 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 20:47:16.163028 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158394 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158402 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158410 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158415 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158422 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158429 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158434 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158438 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158444 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158450 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158455 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158460 2580 flags.go:64] FLAG: --cgroup-root="" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158465 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158470 2580 flags.go:64] FLAG: --client-ca-file="" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158475 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158479 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158490 2580 flags.go:64] FLAG: --cluster-domain="" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158495 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158500 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158505 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158510 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158516 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158540 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 20:47:16.163553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158547 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158555 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158560 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158565 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158570 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158575 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158580 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158586 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158591 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158596 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158601 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158606 2580 flags.go:64] FLAG: --enable-server="true" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158612 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158620 2580 flags.go:64] FLAG: --event-burst="100" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158625 2580 flags.go:64] FLAG: --event-qps="50" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158630 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158634 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158638 2580 flags.go:64] FLAG: --eviction-hard="" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158644 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158649 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158656 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158662 2580 flags.go:64] FLAG: --eviction-soft="" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158667 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158672 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158677 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 20:47:16.164241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158682 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158686 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158691 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158696 2580 flags.go:64] FLAG: --feature-gates="" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158702 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158707 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158712 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158717 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158724 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158729 2580 flags.go:64] FLAG: --help="false" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158734 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158741 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158745 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158750 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158756 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158762 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158766 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158771 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158776 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158781 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158786 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158792 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158797 2580 flags.go:64] FLAG: --kube-reserved="" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158802 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 20:47:16.164898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158807 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158812 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158817 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158824 2580 flags.go:64] FLAG: --lock-file="" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158828 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158833 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158838 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158847 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158853 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158857 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158862 2580 flags.go:64] FLAG: --logging-format="text" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158867 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158872 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158877 2580 flags.go:64] FLAG: --manifest-url="" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158882 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158888 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158895 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158902 2580 flags.go:64] FLAG: --max-pods="110" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158907 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158912 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158916 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158921 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158926 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158932 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158937 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 20:47:16.165483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158948 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158954 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158959 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158964 2580 flags.go:64] FLAG: --pod-cidr="" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158969 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158978 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158982 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158987 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158992 2580 flags.go:64] FLAG: --port="10250" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.158996 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159003 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b95b9e9ea5a9e1e2" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159008 2580 flags.go:64] FLAG: --qos-reserved="" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159013 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159018 2580 flags.go:64] FLAG: --register-node="true" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159023 2580 flags.go:64] FLAG: --register-with-taints="" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159029 2580 flags.go:64] FLAG: --registry-burst="10" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159033 2580 flags.go:64] FLAG: --registry-qps="5" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159038 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159043 2580 flags.go:64] FLAG: --reserved-memory="" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159049 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159054 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159059 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159064 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159068 2580 flags.go:64] FLAG: --runonce="false" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159075 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 20:47:16.166159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159080 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159085 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159090 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159094 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159099 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159104 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159109 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159113 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159118 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159122 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159127 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159132 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159138 2580 flags.go:64] FLAG: --system-cgroups="" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159143 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159151 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159156 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159161 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159169 2580 flags.go:64] FLAG: --tls-min-version="" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159174 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159179 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159184 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159189 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159194 2580 flags.go:64] FLAG: --v="2" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159200 2580 flags.go:64] FLAG: --version="false" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159211 2580 flags.go:64] FLAG: --vmodule="" Sep 09 20:47:16.166799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159217 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.159222 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159417 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159425 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159430 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159435 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159441 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159446 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159450 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159455 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159459 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159463 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159469 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159474 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159479 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159483 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159488 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159492 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159496 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159500 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:47:16.167437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159505 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159509 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159514 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159518 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159540 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159545 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159549 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159553 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159557 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159562 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159566 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159570 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159574 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159578 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159583 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159587 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159593 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159599 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159627 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:47:16.167958 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159634 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159640 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159646 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159651 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159656 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159660 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159665 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159669 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159673 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159677 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159681 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159686 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159690 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159694 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159703 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159708 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159712 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159718 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159723 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159727 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:47:16.168437 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159730 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159735 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159739 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159743 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159747 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159751 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159755 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159759 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159763 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159767 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159771 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159775 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159780 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159784 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159788 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159793 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159796 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159800 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159805 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159809 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:47:16.168939 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159813 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159817 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159821 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159825 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159830 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159834 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159838 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159843 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159847 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159853 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159857 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159861 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159868 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159873 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159878 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159883 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159887 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159892 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159896 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:47:16.169417 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159900 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159904 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.159908 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.160669 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.168701 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.168717 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.169712 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.169719 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169776 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169781 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169784 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169787 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169790 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169793 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169796 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:47:16.169898 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169799 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169802 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169805 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169808 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169810 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169813 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169816 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169818 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169821 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169824 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169826 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169829 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169831 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169834 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169838 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169840 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169845 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169849 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169852 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:47:16.170277 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169855 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169857 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169860 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169864 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169866 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169869 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169872 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169874 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169877 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169879 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169882 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169885 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169888 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169890 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169893 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169895 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169898 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169901 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169904 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169906 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:47:16.170879 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169909 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169911 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169914 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169917 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169920 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169924 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169928 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169931 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169933 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169936 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169939 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169941 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169944 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169947 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169949 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169952 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169956 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169958 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169961 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:47:16.171366 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169965 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169969 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169972 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169974 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169977 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169980 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169983 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169985 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169988 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169990 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169993 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169996 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.169998 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170001 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170003 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170006 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170008 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170011 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170013 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170017 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:47:16.171847 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170019 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170022 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170024 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170027 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170030 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170032 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170035 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170037 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170041 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170043 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170046 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170049 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170052 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170054 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:47:16.172320 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.170059 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170172 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170177 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170180 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170183 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170186 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170189 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170192 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170195 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170198 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170200 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170203 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170206 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170208 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170211 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170214 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170216 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170219 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170222 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:47:16.172679 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170224 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170226 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170229 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170232 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170234 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170236 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170239 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170242 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170244 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170247 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170250 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170253 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170255 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170258 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170261 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170263 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170266 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170269 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170271 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170274 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:47:16.173137 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170276 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170279 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170282 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170285 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170287 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170290 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170293 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170295 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170298 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170300 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170303 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170306 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170308 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170311 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170313 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170316 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170319 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170322 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170324 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170327 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:47:16.173648 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170330 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170332 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170334 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170337 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170340 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170342 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170345 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170347 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170350 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170352 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170355 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170357 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170360 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170362 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170365 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170367 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170371 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170374 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170377 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170380 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:47:16.174125 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170383 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170387 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170390 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170393 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170396 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170398 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170401 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170404 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170406 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170409 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170412 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170415 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170417 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170420 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170422 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170425 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170428 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170430 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170433 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170435 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:47:16.174621 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:16.170438 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:47:16.175118 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.170443 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:47:16.175118 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.170581 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 20:47:16.175118 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.173768 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 20:47:16.175118 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.174787 2580 server.go:1019] "Starting client certificate rotation" Sep 09 20:47:16.175118 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.174882 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 20:47:16.175118 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.174918 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 20:47:16.177766 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.177752 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 20:47:16.182800 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.182783 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 20:47:16.194573 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.194551 2580 log.go:25] "Validated CRI v1 runtime API" Sep 09 20:47:16.197809 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.197794 2580 log.go:25] "Validated CRI v1 image API" Sep 09 20:47:16.198666 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.198649 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 20:47:16.201334 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.201315 2580 fs.go:135] Filesystem UUIDs: map[32dfdc5e-dee3-492c-95f9-8245f02ee16f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fc2b3a8a-506b-48b1-b9f2-1dc5fd6e7810:/dev/nvme0n1p4] Sep 09 20:47:16.201392 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.201332 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 20:47:16.205636 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.205518 2580 manager.go:216] Machine: {Timestamp:2026-09-09 20:47:16.205033519 +0000 UTC m=+0.370782333 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099996 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c3f7e1633b941769745e831d380fc SystemUUID:ec2c3f7e-1633-b941-7697-45e831d380fc BootID:38961c55-109f-4e52-9c26-bfa917001d85 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c8:2f:81:21:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c8:2f:81:21:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:9c:9c:2e:cf:6a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 20:47:16.205636 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.205635 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 20:47:16.205748 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.205737 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 20:47:16.208311 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.208290 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 20:47:16.208445 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.208313 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 20:47:16.209889 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.209875 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 20:47:16.209939 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.209893 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 20:47:16.209939 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.209901 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 20:47:16.211032 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.211022 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 20:47:16.212209 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.212194 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 20:47:16.212934 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.212922 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 20:47:16.217978 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.217967 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 09 20:47:16.218091 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.218082 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 20:47:16.218122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.218110 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 09 20:47:16.218122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.218119 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 20:47:16.218172 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.218133 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 20:47:16.218172 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.218142 2580 kubelet.go:398] "Adding apiserver pod source" Sep 09 20:47:16.218172 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.218151 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 20:47:16.218499 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.218484 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 20:47:16.218572 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.218508 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 20:47:16.220973 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.220954 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 20:47:16.223925 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.223909 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 20:47:16.223963 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.223942 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 20:47:16.224180 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224169 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 20:47:16.224217 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224187 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 20:47:16.224217 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224194 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 20:47:16.224217 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224199 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 20:47:16.224217 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224207 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 20:47:16.224217 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224213 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 20:47:16.224812 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224802 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 20:47:16.224841 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224812 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 20:47:16.224841 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224831 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 20:47:16.224841 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224837 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 20:47:16.224926 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224845 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 20:47:16.224926 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.224852 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 20:47:16.225742 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.225731 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 20:47:16.225777 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.225742 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 20:47:16.226931 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.226909 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 20:47:16.226974 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.226909 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 20:47:16.227164 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.227152 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 20:47:16.229789 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.229777 2580 server.go:1268] "Started kubelet" Sep 09 20:47:16.234629 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.234129 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 20:47:16.234629 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.229878 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 20:47:16.234629 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.234538 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 20:47:16.235220 ip-10-0-132-118 systemd[1]: Started Kubernetes Kubelet. Sep 09 20:47:16.236499 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.236465 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 20:47:16.239099 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.238414 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 09 20:47:16.239927 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.239908 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 20:47:16.240666 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.239333 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-118.ec2.internal.18d3c20c91523ded default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-118.ec2.internal,UID:ip-10-0-132-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-118.ec2.internal,},FirstTimestamp:2026-09-09 20:47:16.229701101 +0000 UTC m=+0.395449915,LastTimestamp:2026-09-09 20:47:16.229701101 +0000 UTC m=+0.395449915,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-118.ec2.internal,}" Sep 09 20:47:16.243992 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.243971 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 20:47:16.244645 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.244633 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 20:47:16.244802 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.244785 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:16.245401 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245386 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 20:47:16.245401 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245404 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 20:47:16.245539 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245412 2580 factory.go:55] Registering systemd factory Sep 09 20:47:16.245539 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245387 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 20:47:16.245539 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245425 2580 factory.go:223] Registration of the systemd container factory successfully Sep 09 20:47:16.245539 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245473 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 09 20:47:16.245539 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245479 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 09 20:47:16.245723 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245650 2580 factory.go:153] Registering CRI-O factory Sep 09 20:47:16.245723 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245660 2580 factory.go:223] Registration of the crio container factory successfully Sep 09 20:47:16.245723 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245700 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 20:47:16.245723 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245714 2580 factory.go:103] Registering Raw factory Sep 09 20:47:16.245723 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.245724 2580 manager.go:1196] Started watching for new ooms in manager Sep 09 20:47:16.246226 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.246208 2580 manager.go:349] Starting recovery of all containers Sep 09 20:47:16.256983 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.256952 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 20:47:16.257087 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.257061 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 20:47:16.257264 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.257247 2580 manager.go:354] Recovery completed Sep 09 20:47:16.261925 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.261904 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:47:16.264441 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.264424 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:47:16.264501 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.264450 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:47:16.264501 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.264461 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:47:16.265063 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.265046 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 20:47:16.265063 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.265059 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 20:47:16.265175 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.265075 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 09 20:47:16.265175 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.265058 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:47:16.265869 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.265852 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:47:16.265953 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.265880 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:47:16.265953 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.265890 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:47:16.266726 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.266661 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-118.ec2.internal.18d3c20c93645201 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-118.ec2.internal,UID:ip-10-0-132-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-118.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-118.ec2.internal,},FirstTimestamp:2026-09-09 20:47:16.264440321 +0000 UTC m=+0.430189136,LastTimestamp:2026-09-09 20:47:16.264440321 +0000 UTC m=+0.430189136,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-118.ec2.internal,}" Sep 09 20:47:16.267122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.267109 2580 policy_none.go:49] "None policy: Start" Sep 09 20:47:16.267122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.267124 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 20:47:16.267243 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.267134 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 20:47:16.269005 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.268993 2580 policy_none.go:47] "Start" Sep 09 20:47:16.278170 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.278102 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-118.ec2.internal.18d3c20c93648856 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-118.ec2.internal,UID:ip-10-0-132-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-118.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-118.ec2.internal,},FirstTimestamp:2026-09-09 20:47:16.26445423 +0000 UTC m=+0.430203045,LastTimestamp:2026-09-09 20:47:16.26445423 +0000 UTC m=+0.430203045,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-118.ec2.internal,}" Sep 09 20:47:16.286056 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.285988 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-118.ec2.internal.18d3c20c9364b3a6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-118.ec2.internal,UID:ip-10-0-132-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-118.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-118.ec2.internal,},FirstTimestamp:2026-09-09 20:47:16.264465318 +0000 UTC m=+0.430214133,LastTimestamp:2026-09-09 20:47:16.264465318 +0000 UTC m=+0.430214133,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-118.ec2.internal,}" Sep 09 20:47:16.293157 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.293132 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lpn5c" Sep 09 20:47:16.294860 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.294806 2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-118.ec2.internal.18d3c20c93645201\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-118.ec2.internal.18d3c20c93645201 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-118.ec2.internal,UID:ip-10-0-132-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-118.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-118.ec2.internal,},FirstTimestamp:2026-09-09 20:47:16.264440321 +0000 UTC m=+0.430189136,LastTimestamp:2026-09-09 20:47:16.26586826 +0000 UTC m=+0.431617078,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-118.ec2.internal,}" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.298664 2580 manager.go:337] "Starting Device Plugin manager" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.298706 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.298719 2580 server.go:87] "Starting device plugin registration server" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.298975 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.298986 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.299103 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.299179 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.299188 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.299803 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.299853 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.304766 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lpn5c" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.305095 2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-118.ec2.internal.18d3c20c93648856\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-118.ec2.internal.18d3c20c93648856 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-118.ec2.internal,UID:ip-10-0-132-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-118.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-118.ec2.internal,},FirstTimestamp:2026-09-09 20:47:16.26445423 +0000 UTC m=+0.430203045,LastTimestamp:2026-09-09 20:47:16.265885479 +0000 UTC m=+0.431634293,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-118.ec2.internal,}" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.313796 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.315365 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.315413 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.315436 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.315479 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 20:47:16.323726 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.317284 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:47:16.399197 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.399069 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:47:16.400255 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.400229 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:47:16.400350 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.400270 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:47:16.400350 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.400285 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:47:16.400350 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.400315 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.408294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.408278 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.408336 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.408301 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-118.ec2.internal\": node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:16.416327 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.416309 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal"] Sep 09 20:47:16.416381 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.416372 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:47:16.418091 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.418072 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:47:16.418192 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.418104 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:47:16.418192 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.418120 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:47:16.420168 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.420146 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:47:16.420265 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.420251 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.420313 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.420279 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:47:16.421927 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.421912 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:47:16.422003 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.421933 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:47:16.422003 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.421943 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:47:16.422003 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.421916 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:47:16.422098 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.422006 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:47:16.422098 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.422016 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:47:16.423937 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.423925 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.423978 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.423947 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:47:16.426027 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.426014 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:47:16.426096 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.426037 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:47:16.426096 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.426046 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:47:16.432862 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.432841 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:16.445055 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.445032 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-118.ec2.internal\" not found" node="ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.446045 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.446026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72de7aab8a14ebc53b79cddbb9a80062-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal\" (UID: \"72de7aab8a14ebc53b79cddbb9a80062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.446127 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.446055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72de7aab8a14ebc53b79cddbb9a80062-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal\" (UID: \"72de7aab8a14ebc53b79cddbb9a80062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.446127 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.446081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/942be75416b9572b238c9a5fb039e0c8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-118.ec2.internal\" (UID: \"942be75416b9572b238c9a5fb039e0c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.447165 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.447148 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-118.ec2.internal\" not found" node="ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.533076 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.533044 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:16.547032 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.547005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72de7aab8a14ebc53b79cddbb9a80062-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal\" (UID: \"72de7aab8a14ebc53b79cddbb9a80062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.547032 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.547032 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72de7aab8a14ebc53b79cddbb9a80062-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal\" (UID: \"72de7aab8a14ebc53b79cddbb9a80062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.547210 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.547049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/942be75416b9572b238c9a5fb039e0c8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-118.ec2.internal\" (UID: \"942be75416b9572b238c9a5fb039e0c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.547210 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.547087 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/942be75416b9572b238c9a5fb039e0c8-config\") pod \"kube-apiserver-proxy-ip-10-0-132-118.ec2.internal\" (UID: \"942be75416b9572b238c9a5fb039e0c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.547210 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.547110 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72de7aab8a14ebc53b79cddbb9a80062-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal\" (UID: \"72de7aab8a14ebc53b79cddbb9a80062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.547210 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.547119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72de7aab8a14ebc53b79cddbb9a80062-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal\" (UID: \"72de7aab8a14ebc53b79cddbb9a80062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.633338 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.633304 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:16.734357 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.734333 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:16.748638 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.748622 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.750783 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:16.750766 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal" Sep 09 20:47:16.834786 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.834759 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:16.935279 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:16.935256 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:18.599785 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:18.599732 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:18.700308 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:18.700270 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:18.738753 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:18.738727 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 20:47:18.739175 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:18.738885 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 20:47:18.801171 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:18.800942 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:18.869780 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:18.869732 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72de7aab8a14ebc53b79cddbb9a80062.slice/crio-eb4bc5dcf126dd3e23dc94e143930fb17b9c675e532aefd2b4dc82c8434e6bdd WatchSource:0}: Error finding container eb4bc5dcf126dd3e23dc94e143930fb17b9c675e532aefd2b4dc82c8434e6bdd: Status 404 returned error can't find the container with id eb4bc5dcf126dd3e23dc94e143930fb17b9c675e532aefd2b4dc82c8434e6bdd Sep 09 20:47:18.871884 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:18.871830 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 20:42:17 +0000 UTC" deadline="2028-05-21 20:44:23.723371178 +0000 UTC" Sep 09 20:47:18.871884 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:18.871855 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14879h57m4.851518792s" Sep 09 20:47:18.874424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:18.874408 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:47:18.880282 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:18.880263 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:47:18.883014 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:18.882971 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" event={"ID":"72de7aab8a14ebc53b79cddbb9a80062","Type":"ContainerStarted","Data":"eb4bc5dcf126dd3e23dc94e143930fb17b9c675e532aefd2b4dc82c8434e6bdd"} Sep 09 20:47:18.902117 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:18.902093 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-118.ec2.internal\" not found" Sep 09 20:47:18.906601 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:18.906575 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942be75416b9572b238c9a5fb039e0c8.slice/crio-84fd6001c8d58edd4a2a01ad42133dc2bd11738a6c2c45f58a95a3fbd0c4162b WatchSource:0}: Error finding container 84fd6001c8d58edd4a2a01ad42133dc2bd11738a6c2c45f58a95a3fbd0c4162b: Status 404 returned error can't find the container with id 84fd6001c8d58edd4a2a01ad42133dc2bd11738a6c2c45f58a95a3fbd0c4162b Sep 09 20:47:18.919957 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:18.919935 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:47:18.954394 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:18.954363 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:47:19.008999 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.008972 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" Sep 09 20:47:19.029738 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.029716 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 20:47:19.030975 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.030959 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal" Sep 09 20:47:19.041051 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.041031 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 20:47:19.783625 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.783595 2580 apiserver.go:52] "Watching apiserver" Sep 09 20:47:19.790250 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.790221 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 20:47:19.790628 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.790600 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-b5495","openshift-dns/node-resolver-w5g8k","openshift-multus/multus-additional-cni-plugins-t9hbd","openshift-network-diagnostics/network-check-target-4gczh","kube-system/global-pull-secret-syncer-gfmr9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf","openshift-image-registry/node-ca-5kpxb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal","openshift-multus/multus-c7lmx","openshift-multus/network-metrics-daemon-9k7qt","openshift-network-operator/iptables-alerter-vf2s7","openshift-ovn-kubernetes/ovnkube-node-jbjbj","kube-system/konnectivity-agent-krxz8","kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal"] Sep 09 20:47:19.793105 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.793075 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.795723 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.795403 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.795988 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.795964 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 20:47:19.796238 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.796211 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nwg47\"" Sep 09 20:47:19.796439 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.796412 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:47:19.797653 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.797536 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 20:47:19.797746 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.797660 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 20:47:19.797868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.797850 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 20:47:19.797943 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.797923 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 20:47:19.798017 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.798002 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-54c4s\"" Sep 09 20:47:19.798143 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.798124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.800261 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.799851 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:19.800261 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:19.799931 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:19.800431 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.800315 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 20:47:19.800431 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.800382 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rsct6\"" Sep 09 20:47:19.800651 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.800315 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 20:47:19.800651 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.800621 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 20:47:19.802050 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.802033 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:19.802144 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:19.802095 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:19.808327 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.804683 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.808327 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.807077 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 20:47:19.808327 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.807311 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 20:47:19.808327 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.807649 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.808593 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.808330 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 20:47:19.809285 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.808661 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xw5fb\"" Sep 09 20:47:19.809285 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.809001 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 20:47:19.809601 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.809577 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 20:47:19.809685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.809637 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 20:47:19.809920 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.809904 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvgpm\"" Sep 09 20:47:19.810353 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.810333 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:19.812216 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.812200 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 20:47:19.812506 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.812488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:19.812606 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:19.812558 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:19.812670 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.812642 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 20:47:19.812741 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.812716 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b65vl\"" Sep 09 20:47:19.814920 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.814902 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:19.817643 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.817390 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 20:47:19.817643 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.817429 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vb7gd\"" Sep 09 20:47:19.817643 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.817455 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.817643 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.817613 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 20:47:19.818418 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.818045 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:47:19.819517 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:19.819517 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-sysctl-d\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.819649 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-lib-modules\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.819649 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-hostroot\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.819649 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-run-multus-certs\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.819649 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/016e1f64-8347-482f-ba28-c31904328c16-dbus\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:19.819649 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.819649 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-run\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-var-lib-kubelet\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819696 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8bmv\" (UniqueName: \"kubernetes.io/projected/2e34bfd3-5f54-48e6-9be4-03ebabce312f-kube-api-access-b8bmv\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-modprobe-d\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-cni-dir\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-systemd\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819785 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-device-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r84gg\" (UniqueName: \"kubernetes.io/projected/0a385051-1f26-4c84-959c-7a561354e285-kube-api-access-r84gg\") pod \"node-ca-5kpxb\" (UID: \"0a385051-1f26-4c84-959c-7a561354e285\") " pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819865 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-sysconfig\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-var-lib-cni-bin\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.819931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2715ed-3169-453c-9ddb-3f9b9a31472d-tmp-dir\") pod \"node-resolver-w5g8k\" (UID: \"4b2715ed-3169-453c-9ddb-3f9b9a31472d\") " pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819950 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-sysctl-conf\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-tuned\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.819996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-system-cni-dir\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820017 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a385051-1f26-4c84-959c-7a561354e285-host\") pod \"node-ca-5kpxb\" (UID: \"0a385051-1f26-4c84-959c-7a561354e285\") " pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-cnibin\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820067 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820073 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e34bfd3-5f54-48e6-9be4-03ebabce312f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tk6t\" (UniqueName: \"kubernetes.io/projected/cdd74e32-7d21-4211-842b-199f04ae50dc-kube-api-access-2tk6t\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-daemon-config\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.820484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820453 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e34bfd3-5f54-48e6-9be4-03ebabce312f-system-cni-dir\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e34bfd3-5f54-48e6-9be4-03ebabce312f-cnibin\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e34bfd3-5f54-48e6-9be4-03ebabce312f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knbt2\" (UniqueName: \"kubernetes.io/projected/495b5948-934d-44e1-bc9d-4576e8a2bdf3-kube-api-access-knbt2\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5xb5\" (UniqueName: \"kubernetes.io/projected/2d1561c7-7538-4e2f-906e-33004504e1bd-kube-api-access-t5xb5\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820580 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820597 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-kubernetes\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-var-lib-kubelet\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820643 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-etc-kubernetes\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b2715ed-3169-453c-9ddb-3f9b9a31472d-hosts-file\") pod \"node-resolver-w5g8k\" (UID: \"4b2715ed-3169-453c-9ddb-3f9b9a31472d\") " pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v95tv\" (UniqueName: \"kubernetes.io/projected/4b2715ed-3169-453c-9ddb-3f9b9a31472d-kube-api-access-v95tv\") pod \"node-resolver-w5g8k\" (UID: \"4b2715ed-3169-453c-9ddb-3f9b9a31472d\") " pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-sys\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-host\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/495b5948-934d-44e1-bc9d-4576e8a2bdf3-tmp\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d1561c7-7538-4e2f-906e-33004504e1bd-cni-binary-copy\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-socket-dir-parent\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e34bfd3-5f54-48e6-9be4-03ebabce312f-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.820971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a385051-1f26-4c84-959c-7a561354e285-serviceca\") pod \"node-ca-5kpxb\" (UID: \"0a385051-1f26-4c84-959c-7a561354e285\") " pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820878 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-socket-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820941 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.820981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e34bfd3-5f54-48e6-9be4-03ebabce312f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/016e1f64-8347-482f-ba28-c31904328c16-kubelet-config\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-sys-fs\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821050 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-run-k8s-cni-cncf-io\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-var-lib-cni-multus\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821107 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-registration-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821138 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-run-netns\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821163 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821384 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ghr7z\"" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821570 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821769 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 20:47:19.821793 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821797 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 20:47:19.822560 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.821162 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-conf-dir\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.822560 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.822069 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 20:47:19.823642 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.823457 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 20:47:19.823642 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.823516 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-glpps\"" Sep 09 20:47:19.824415 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.824319 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 20:47:19.844862 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.844831 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxqvf" Sep 09 20:47:19.853342 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.853324 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxqvf" Sep 09 20:47:19.885788 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.885758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal" event={"ID":"942be75416b9572b238c9a5fb039e0c8","Type":"ContainerStarted","Data":"84fd6001c8d58edd4a2a01ad42133dc2bd11738a6c2c45f58a95a3fbd0c4162b"} Sep 09 20:47:19.910720 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.910700 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 20:47:19.922627 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-registration-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.922771 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-run-netns\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.922771 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-conf-dir\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.922771 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-run-netns\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.922771 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021-agent-certs\") pod \"konnectivity-agent-krxz8\" (UID: \"4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021\") " pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:19.922771 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922728 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-run-netns\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.922771 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021-konnectivity-ca\") pod \"konnectivity-agent-krxz8\" (UID: \"4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021\") " pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:19.922771 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-registration-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922775 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-conf-dir\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-sysctl-d\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-lib-modules\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922876 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-hostroot\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-run-multus-certs\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-slash\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:19.922944 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.922989 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:19.923038 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret podName:016e1f64-8347-482f-ba28-c31904328c16 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:20.423002417 +0000 UTC m=+3.024813987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret") pod "global-pull-secret-syncer-gfmr9" (UID: "016e1f64-8347-482f-ba28-c31904328c16") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923052 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-hostroot\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/016e1f64-8347-482f-ba28-c31904328c16-dbus\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:19.923075 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923065 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-sysctl-d\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923082 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-lib-modules\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923086 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-run-multus-certs\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-run\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923193 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923228 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/016e1f64-8347-482f-ba28-c31904328c16-dbus\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-var-lib-kubelet\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923256 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-run\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8bmv\" (UniqueName: \"kubernetes.io/projected/2e34bfd3-5f54-48e6-9be4-03ebabce312f-kube-api-access-b8bmv\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923321 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-var-lib-kubelet\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-log-socket\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3692b29f-5713-4b8f-8176-6edd683ed11b-ovnkube-script-lib\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-modprobe-d\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-cni-dir\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923557 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-modprobe-d\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923561 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-run-ovn-kubernetes\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.923697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923599 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-cni-dir\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-cni-bin\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3692b29f-5713-4b8f-8176-6edd683ed11b-ovnkube-config\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-systemd\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-device-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r84gg\" (UniqueName: \"kubernetes.io/projected/0a385051-1f26-4c84-959c-7a561354e285-kube-api-access-r84gg\") pod \"node-ca-5kpxb\" (UID: \"0a385051-1f26-4c84-959c-7a561354e285\") " pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-sysconfig\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-systemd\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-var-lib-cni-bin\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923823 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f45ffbf7-4819-48f2-82ab-8eb3842d6d19-iptables-alerter-script\") pod \"iptables-alerter-vf2s7\" (UID: \"f45ffbf7-4819-48f2-82ab-8eb3842d6d19\") " pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923827 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-device-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923855 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-sysconfig\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-cni-netd\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923857 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-var-lib-cni-bin\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ktzf\" (UniqueName: \"kubernetes.io/projected/3692b29f-5713-4b8f-8176-6edd683ed11b-kube-api-access-5ktzf\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2715ed-3169-453c-9ddb-3f9b9a31472d-tmp-dir\") pod \"node-resolver-w5g8k\" (UID: \"4b2715ed-3169-453c-9ddb-3f9b9a31472d\") " pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:19.924617 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.923940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-sysctl-conf\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-tuned\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-system-cni-dir\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924045 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-sysctl-conf\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924053 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a385051-1f26-4c84-959c-7a561354e285-host\") pod \"node-ca-5kpxb\" (UID: \"0a385051-1f26-4c84-959c-7a561354e285\") " pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-cnibin\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924109 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e34bfd3-5f54-48e6-9be4-03ebabce312f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-system-cni-dir\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tk6t\" (UniqueName: \"kubernetes.io/projected/cdd74e32-7d21-4211-842b-199f04ae50dc-kube-api-access-2tk6t\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924139 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a385051-1f26-4c84-959c-7a561354e285-host\") pod \"node-ca-5kpxb\" (UID: \"0a385051-1f26-4c84-959c-7a561354e285\") " pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-daemon-config\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e34bfd3-5f54-48e6-9be4-03ebabce312f-system-cni-dir\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924191 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-cnibin\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e34bfd3-5f54-48e6-9be4-03ebabce312f-cnibin\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b2715ed-3169-453c-9ddb-3f9b9a31472d-tmp-dir\") pod \"node-resolver-w5g8k\" (UID: \"4b2715ed-3169-453c-9ddb-3f9b9a31472d\") " pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e34bfd3-5f54-48e6-9be4-03ebabce312f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f45ffbf7-4819-48f2-82ab-8eb3842d6d19-host-slash\") pod \"iptables-alerter-vf2s7\" (UID: \"f45ffbf7-4819-48f2-82ab-8eb3842d6d19\") " pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:19.925438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-run-systemd\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924384 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-var-lib-openvswitch\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924410 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e34bfd3-5f54-48e6-9be4-03ebabce312f-system-cni-dir\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knbt2\" (UniqueName: \"kubernetes.io/projected/495b5948-934d-44e1-bc9d-4576e8a2bdf3-kube-api-access-knbt2\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5xb5\" (UniqueName: \"kubernetes.io/projected/2d1561c7-7538-4e2f-906e-33004504e1bd-kube-api-access-t5xb5\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-systemd-units\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-run-openvswitch\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-run-ovn\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-node-log\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-kubernetes\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-var-lib-kubelet\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924624 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-etc-kubernetes\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-kubelet\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924665 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924735 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-kubernetes\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924776 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-var-lib-kubelet\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924818 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-etc-kubernetes\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.926069 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924814 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e34bfd3-5f54-48e6-9be4-03ebabce312f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924850 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e34bfd3-5f54-48e6-9be4-03ebabce312f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924858 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e34bfd3-5f54-48e6-9be4-03ebabce312f-cnibin\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924901 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-daemon-config\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924925 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b2715ed-3169-453c-9ddb-3f9b9a31472d-hosts-file\") pod \"node-resolver-w5g8k\" (UID: \"4b2715ed-3169-453c-9ddb-3f9b9a31472d\") " pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.924672 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b2715ed-3169-453c-9ddb-3f9b9a31472d-hosts-file\") pod \"node-resolver-w5g8k\" (UID: \"4b2715ed-3169-453c-9ddb-3f9b9a31472d\") " pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v95tv\" (UniqueName: \"kubernetes.io/projected/4b2715ed-3169-453c-9ddb-3f9b9a31472d-kube-api-access-v95tv\") pod \"node-resolver-w5g8k\" (UID: \"4b2715ed-3169-453c-9ddb-3f9b9a31472d\") " pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-sys\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-host\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925111 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-sys\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925126 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/495b5948-934d-44e1-bc9d-4576e8a2bdf3-host\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/495b5948-934d-44e1-bc9d-4576e8a2bdf3-tmp\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d1561c7-7538-4e2f-906e-33004504e1bd-cni-binary-copy\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-socket-dir-parent\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e34bfd3-5f54-48e6-9be4-03ebabce312f-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a385051-1f26-4c84-959c-7a561354e285-serviceca\") pod \"node-ca-5kpxb\" (UID: \"0a385051-1f26-4c84-959c-7a561354e285\") " pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-socket-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.926897 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925450 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925344 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-multus-socket-dir-parent\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925516 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e34bfd3-5f54-48e6-9be4-03ebabce312f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2ln\" (UniqueName: \"kubernetes.io/projected/baaab02f-8a89-400e-a327-f5d48b6907b5-kube-api-access-ls2ln\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925560 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-socket-dir\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925595 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3692b29f-5713-4b8f-8176-6edd683ed11b-env-overrides\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/016e1f64-8347-482f-ba28-c31904328c16-kubelet-config\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-sys-fs\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-run-k8s-cni-cncf-io\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-var-lib-cni-multus\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925725 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx2n5\" (UniqueName: \"kubernetes.io/projected/f45ffbf7-4819-48f2-82ab-8eb3842d6d19-kube-api-access-hx2n5\") pod \"iptables-alerter-vf2s7\" (UID: \"f45ffbf7-4819-48f2-82ab-8eb3842d6d19\") " pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-etc-openvswitch\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925755 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d1561c7-7538-4e2f-906e-33004504e1bd-cni-binary-copy\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3692b29f-5713-4b8f-8176-6edd683ed11b-ovn-node-metrics-cert\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925794 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a385051-1f26-4c84-959c-7a561354e285-serviceca\") pod \"node-ca-5kpxb\" (UID: \"0a385051-1f26-4c84-959c-7a561354e285\") " pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925827 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/016e1f64-8347-482f-ba28-c31904328c16-kubelet-config\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:19.927586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-var-lib-cni-multus\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.928335 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925880 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cdd74e32-7d21-4211-842b-199f04ae50dc-sys-fs\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.928335 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925880 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d1561c7-7538-4e2f-906e-33004504e1bd-host-run-k8s-cni-cncf-io\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.928335 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.925891 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e34bfd3-5f54-48e6-9be4-03ebabce312f-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.928335 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.926020 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e34bfd3-5f54-48e6-9be4-03ebabce312f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.928831 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.928799 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/495b5948-934d-44e1-bc9d-4576e8a2bdf3-tmp\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.928909 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.928859 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/495b5948-934d-44e1-bc9d-4576e8a2bdf3-etc-tuned\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.932210 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:19.931854 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:47:19.932210 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:19.931879 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:47:19.932210 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:19.931894 2580 projected.go:196] Error preparing data for projected volume kube-api-access-cnh95 for pod openshift-network-diagnostics/network-check-target-4gczh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:19.932210 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:19.931962 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95 podName:2c84e099-4a09-4090-a6a4-883970cabc6f nodeName:}" failed. No retries permitted until 2026-09-09 20:47:20.431945769 +0000 UTC m=+3.033757337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cnh95" (UniqueName: "kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95") pod "network-check-target-4gczh" (UID: "2c84e099-4a09-4090-a6a4-883970cabc6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:19.932210 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.932147 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8bmv\" (UniqueName: \"kubernetes.io/projected/2e34bfd3-5f54-48e6-9be4-03ebabce312f-kube-api-access-b8bmv\") pod \"multus-additional-cni-plugins-t9hbd\" (UID: \"2e34bfd3-5f54-48e6-9be4-03ebabce312f\") " pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:19.934057 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.934032 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5xb5\" (UniqueName: \"kubernetes.io/projected/2d1561c7-7538-4e2f-906e-33004504e1bd-kube-api-access-t5xb5\") pod \"multus-c7lmx\" (UID: \"2d1561c7-7538-4e2f-906e-33004504e1bd\") " pod="openshift-multus/multus-c7lmx" Sep 09 20:47:19.934155 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.934030 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tk6t\" (UniqueName: \"kubernetes.io/projected/cdd74e32-7d21-4211-842b-199f04ae50dc-kube-api-access-2tk6t\") pod \"aws-ebs-csi-driver-node-6kkcf\" (UID: \"cdd74e32-7d21-4211-842b-199f04ae50dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:19.934543 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.934523 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knbt2\" (UniqueName: \"kubernetes.io/projected/495b5948-934d-44e1-bc9d-4576e8a2bdf3-kube-api-access-knbt2\") pod \"tuned-b5495\" (UID: \"495b5948-934d-44e1-bc9d-4576e8a2bdf3\") " pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:19.935748 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.935730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r84gg\" (UniqueName: \"kubernetes.io/projected/0a385051-1f26-4c84-959c-7a561354e285-kube-api-access-r84gg\") pod \"node-ca-5kpxb\" (UID: \"0a385051-1f26-4c84-959c-7a561354e285\") " pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:19.936360 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:19.936338 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v95tv\" (UniqueName: \"kubernetes.io/projected/4b2715ed-3169-453c-9ddb-3f9b9a31472d-kube-api-access-v95tv\") pod \"node-resolver-w5g8k\" (UID: \"4b2715ed-3169-453c-9ddb-3f9b9a31472d\") " pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:20.026854 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.026821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2ln\" (UniqueName: \"kubernetes.io/projected/baaab02f-8a89-400e-a327-f5d48b6907b5-kube-api-access-ls2ln\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:20.026854 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.026858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3692b29f-5713-4b8f-8176-6edd683ed11b-env-overrides\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027085 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.026883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx2n5\" (UniqueName: \"kubernetes.io/projected/f45ffbf7-4819-48f2-82ab-8eb3842d6d19-kube-api-access-hx2n5\") pod \"iptables-alerter-vf2s7\" (UID: \"f45ffbf7-4819-48f2-82ab-8eb3842d6d19\") " pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:20.027085 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.026908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-etc-openvswitch\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027085 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.026935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3692b29f-5713-4b8f-8176-6edd683ed11b-ovn-node-metrics-cert\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027085 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.026964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-run-netns\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027085 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.026986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021-agent-certs\") pod \"konnectivity-agent-krxz8\" (UID: \"4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021\") " pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:20.027085 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021-konnectivity-ca\") pod \"konnectivity-agent-krxz8\" (UID: \"4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021\") " pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:20.027085 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027043 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-run-netns\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027085 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-slash\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027085 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027008 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-etc-openvswitch\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-log-socket\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027153 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-slash\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3692b29f-5713-4b8f-8176-6edd683ed11b-ovnkube-script-lib\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-run-ovn-kubernetes\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027198 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027203 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-log-socket\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-cni-bin\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3692b29f-5713-4b8f-8176-6edd683ed11b-ovnkube-config\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027258 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-run-ovn-kubernetes\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f45ffbf7-4819-48f2-82ab-8eb3842d6d19-iptables-alerter-script\") pod \"iptables-alerter-vf2s7\" (UID: \"f45ffbf7-4819-48f2-82ab-8eb3842d6d19\") " pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027301 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-cni-bin\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-cni-netd\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027355 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ktzf\" (UniqueName: \"kubernetes.io/projected/3692b29f-5713-4b8f-8176-6edd683ed11b-kube-api-access-5ktzf\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027389 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f45ffbf7-4819-48f2-82ab-8eb3842d6d19-host-slash\") pod \"iptables-alerter-vf2s7\" (UID: \"f45ffbf7-4819-48f2-82ab-8eb3842d6d19\") " pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:20.027559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-run-systemd\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027435 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-var-lib-openvswitch\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3692b29f-5713-4b8f-8176-6edd683ed11b-env-overrides\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-systemd-units\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-run-openvswitch\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027526 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-systemd-units\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-cni-netd\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-run-ovn\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.027576 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027584 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-run-systemd\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027584 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-node-log\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027618 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-node-log\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-kubelet\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.027647 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:20.527630338 +0000 UTC m=+3.129441900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027673 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021-konnectivity-ca\") pod \"konnectivity-agent-krxz8\" (UID: \"4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021\") " pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027697 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-var-lib-openvswitch\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3692b29f-5713-4b8f-8176-6edd683ed11b-ovnkube-script-lib\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.028328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027741 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f45ffbf7-4819-48f2-82ab-8eb3842d6d19-host-slash\") pod \"iptables-alerter-vf2s7\" (UID: \"f45ffbf7-4819-48f2-82ab-8eb3842d6d19\") " pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:20.029137 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027776 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-run-openvswitch\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.029137 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027781 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-host-kubelet\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.029137 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027777 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3692b29f-5713-4b8f-8176-6edd683ed11b-run-ovn\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.029137 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.027800 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3692b29f-5713-4b8f-8176-6edd683ed11b-ovnkube-config\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.029137 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.028153 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f45ffbf7-4819-48f2-82ab-8eb3842d6d19-iptables-alerter-script\") pod \"iptables-alerter-vf2s7\" (UID: \"f45ffbf7-4819-48f2-82ab-8eb3842d6d19\") " pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:20.030477 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.030442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3692b29f-5713-4b8f-8176-6edd683ed11b-ovn-node-metrics-cert\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.030568 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.030525 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021-agent-certs\") pod \"konnectivity-agent-krxz8\" (UID: \"4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021\") " pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:20.038089 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.038023 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2ln\" (UniqueName: \"kubernetes.io/projected/baaab02f-8a89-400e-a327-f5d48b6907b5-kube-api-access-ls2ln\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:20.038228 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.038202 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ktzf\" (UniqueName: \"kubernetes.io/projected/3692b29f-5713-4b8f-8176-6edd683ed11b-kube-api-access-5ktzf\") pod \"ovnkube-node-jbjbj\" (UID: \"3692b29f-5713-4b8f-8176-6edd683ed11b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.038287 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.038231 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx2n5\" (UniqueName: \"kubernetes.io/projected/f45ffbf7-4819-48f2-82ab-8eb3842d6d19-kube-api-access-hx2n5\") pod \"iptables-alerter-vf2s7\" (UID: \"f45ffbf7-4819-48f2-82ab-8eb3842d6d19\") " pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:20.108137 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.108106 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b5495" Sep 09 20:47:20.118096 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.118073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c7lmx" Sep 09 20:47:20.128957 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.128934 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5kpxb" Sep 09 20:47:20.135553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.135532 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" Sep 09 20:47:20.142074 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.142056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" Sep 09 20:47:20.149507 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.149487 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w5g8k" Sep 09 20:47:20.160014 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.159997 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vf2s7" Sep 09 20:47:20.165587 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.165565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:20.172188 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.172173 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:20.235761 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.235737 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:47:20.429714 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.429681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:20.429845 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.429809 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:20.429894 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.429866 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret podName:016e1f64-8347-482f-ba28-c31904328c16 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:21.429849207 +0000 UTC m=+4.031660775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret") pod "global-pull-secret-syncer-gfmr9" (UID: "016e1f64-8347-482f-ba28-c31904328c16") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:20.530658 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.530626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:20.530832 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.530687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:20.530832 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.530799 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:20.530832 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.530818 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:47:20.530978 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.530846 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:47:20.530978 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.530859 2580 projected.go:196] Error preparing data for projected volume kube-api-access-cnh95 for pod openshift-network-diagnostics/network-check-target-4gczh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:20.530978 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.530860 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:21.530843097 +0000 UTC m=+4.132654665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:20.530978 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:20.530922 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95 podName:2c84e099-4a09-4090-a6a4-883970cabc6f nodeName:}" failed. No retries permitted until 2026-09-09 20:47:21.530904823 +0000 UTC m=+4.132716375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnh95" (UniqueName: "kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95") pod "network-check-target-4gczh" (UID: "2c84e099-4a09-4090-a6a4-883970cabc6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:20.758207 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:20.758184 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc0c4d7_5ee3_4d69_9a3e_5ec6fb4be021.slice/crio-c0b04b5c6d7f590f3532611d8ffc4f6058198c739199833412c2286c85f99784 WatchSource:0}: Error finding container c0b04b5c6d7f590f3532611d8ffc4f6058198c739199833412c2286c85f99784: Status 404 returned error can't find the container with id c0b04b5c6d7f590f3532611d8ffc4f6058198c739199833412c2286c85f99784 Sep 09 20:47:20.779886 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:20.779829 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a385051_1f26_4c84_959c_7a561354e285.slice/crio-e974b5fc21fab4e6ab699a53e2e2887bdb1a02e307cd9074750ae5f791a01868 WatchSource:0}: Error finding container e974b5fc21fab4e6ab699a53e2e2887bdb1a02e307cd9074750ae5f791a01868: Status 404 returned error can't find the container with id e974b5fc21fab4e6ab699a53e2e2887bdb1a02e307cd9074750ae5f791a01868 Sep 09 20:47:20.781719 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:20.781698 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3692b29f_5713_4b8f_8176_6edd683ed11b.slice/crio-8dd5998e6fffdeba16d56982ac8338f81f70fca4258acb3f4841398e3550d998 WatchSource:0}: Error finding container 8dd5998e6fffdeba16d56982ac8338f81f70fca4258acb3f4841398e3550d998: Status 404 returned error can't find the container with id 8dd5998e6fffdeba16d56982ac8338f81f70fca4258acb3f4841398e3550d998 Sep 09 20:47:20.782852 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:20.782832 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2715ed_3169_453c_9ddb_3f9b9a31472d.slice/crio-78ff6f98f81c2893402a315e7d2bd078be47bc5f0ce89c92643c617c3a4bc44d WatchSource:0}: Error finding container 78ff6f98f81c2893402a315e7d2bd078be47bc5f0ce89c92643c617c3a4bc44d: Status 404 returned error can't find the container with id 78ff6f98f81c2893402a315e7d2bd078be47bc5f0ce89c92643c617c3a4bc44d Sep 09 20:47:20.784290 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:20.784269 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e34bfd3_5f54_48e6_9be4_03ebabce312f.slice/crio-1b5a3e0fd2f413e75369c6d2395e9595f315187fcad635bacc97ede750eec647 WatchSource:0}: Error finding container 1b5a3e0fd2f413e75369c6d2395e9595f315187fcad635bacc97ede750eec647: Status 404 returned error can't find the container with id 1b5a3e0fd2f413e75369c6d2395e9595f315187fcad635bacc97ede750eec647 Sep 09 20:47:20.785060 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:20.785039 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1561c7_7538_4e2f_906e_33004504e1bd.slice/crio-6d2d68d29f85cae8168a111556b60175f461af3bd6c1afb7f247d7ada59d44f8 WatchSource:0}: Error finding container 6d2d68d29f85cae8168a111556b60175f461af3bd6c1afb7f247d7ada59d44f8: Status 404 returned error can't find the container with id 6d2d68d29f85cae8168a111556b60175f461af3bd6c1afb7f247d7ada59d44f8 Sep 09 20:47:20.786105 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:20.786004 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd74e32_7d21_4211_842b_199f04ae50dc.slice/crio-007cc0a52d34705007a03a7fa8de3787c1fc5d2a94c284ebeb74c2acf9663aec WatchSource:0}: Error finding container 007cc0a52d34705007a03a7fa8de3787c1fc5d2a94c284ebeb74c2acf9663aec: Status 404 returned error can't find the container with id 007cc0a52d34705007a03a7fa8de3787c1fc5d2a94c284ebeb74c2acf9663aec Sep 09 20:47:20.787731 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:20.787712 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45ffbf7_4819_48f2_82ab_8eb3842d6d19.slice/crio-da686d28ea8725a3a74706d42cfe1ed4bd38656745a8be836fad0031d8384e23 WatchSource:0}: Error finding container da686d28ea8725a3a74706d42cfe1ed4bd38656745a8be836fad0031d8384e23: Status 404 returned error can't find the container with id da686d28ea8725a3a74706d42cfe1ed4bd38656745a8be836fad0031d8384e23 Sep 09 20:47:20.856873 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.856831 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:42:19 +0000 UTC" deadline="2028-06-16 02:44:18.162882082 +0000 UTC" Sep 09 20:47:20.856873 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.856870 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15485h56m57.306014214s" Sep 09 20:47:20.891927 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.891896 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal" event={"ID":"942be75416b9572b238c9a5fb039e0c8","Type":"ContainerStarted","Data":"6c01b2f56d7ba65820b7083e29b5ce184f5025930fc0609e956f254005a638b4"} Sep 09 20:47:20.895722 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.895700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vf2s7" event={"ID":"f45ffbf7-4819-48f2-82ab-8eb3842d6d19","Type":"ContainerStarted","Data":"da686d28ea8725a3a74706d42cfe1ed4bd38656745a8be836fad0031d8384e23"} Sep 09 20:47:20.898103 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.898081 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c7lmx" event={"ID":"2d1561c7-7538-4e2f-906e-33004504e1bd","Type":"ContainerStarted","Data":"6d2d68d29f85cae8168a111556b60175f461af3bd6c1afb7f247d7ada59d44f8"} Sep 09 20:47:20.899152 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.899131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" event={"ID":"2e34bfd3-5f54-48e6-9be4-03ebabce312f","Type":"ContainerStarted","Data":"1b5a3e0fd2f413e75369c6d2395e9595f315187fcad635bacc97ede750eec647"} Sep 09 20:47:20.900196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.900175 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w5g8k" event={"ID":"4b2715ed-3169-453c-9ddb-3f9b9a31472d","Type":"ContainerStarted","Data":"78ff6f98f81c2893402a315e7d2bd078be47bc5f0ce89c92643c617c3a4bc44d"} Sep 09 20:47:20.904903 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.904886 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b5495" event={"ID":"495b5948-934d-44e1-bc9d-4576e8a2bdf3","Type":"ContainerStarted","Data":"26e904cc5f3d9ab7d3cd6e5e976c91fa3a52f13fb33b4a413fa20542f9da00d9"} Sep 09 20:47:20.906574 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.906531 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-118.ec2.internal" podStartSLOduration=1.906060368 podStartE2EDuration="1.906060368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:20.905805528 +0000 UTC m=+3.507617098" watchObservedRunningTime="2026-09-09 20:47:20.906060368 +0000 UTC m=+3.507871939" Sep 09 20:47:20.907854 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.907828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" event={"ID":"cdd74e32-7d21-4211-842b-199f04ae50dc","Type":"ContainerStarted","Data":"007cc0a52d34705007a03a7fa8de3787c1fc5d2a94c284ebeb74c2acf9663aec"} Sep 09 20:47:20.909499 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.909476 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" event={"ID":"3692b29f-5713-4b8f-8176-6edd683ed11b","Type":"ContainerStarted","Data":"8dd5998e6fffdeba16d56982ac8338f81f70fca4258acb3f4841398e3550d998"} Sep 09 20:47:20.911098 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.911077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5kpxb" event={"ID":"0a385051-1f26-4c84-959c-7a561354e285","Type":"ContainerStarted","Data":"e974b5fc21fab4e6ab699a53e2e2887bdb1a02e307cd9074750ae5f791a01868"} Sep 09 20:47:20.913616 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:20.913597 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krxz8" event={"ID":"4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021","Type":"ContainerStarted","Data":"c0b04b5c6d7f590f3532611d8ffc4f6058198c739199833412c2286c85f99784"} Sep 09 20:47:21.437052 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.437013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:21.437238 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.437217 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:21.437332 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.437282 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret podName:016e1f64-8347-482f-ba28-c31904328c16 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:23.437261716 +0000 UTC m=+6.039073273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret") pod "global-pull-secret-syncer-gfmr9" (UID: "016e1f64-8347-482f-ba28-c31904328c16") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:21.538352 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.537565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:21.538352 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.537649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:21.538352 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.537782 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:21.538352 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.537840 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:23.537822142 +0000 UTC m=+6.139633696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:21.538352 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.538233 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:47:21.538352 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.538250 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:47:21.538352 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.538263 2580 projected.go:196] Error preparing data for projected volume kube-api-access-cnh95 for pod openshift-network-diagnostics/network-check-target-4gczh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:21.538352 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.538306 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95 podName:2c84e099-4a09-4090-a6a4-883970cabc6f nodeName:}" failed. No retries permitted until 2026-09-09 20:47:23.538291104 +0000 UTC m=+6.140102659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnh95" (UniqueName: "kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95") pod "network-check-target-4gczh" (UID: "2c84e099-4a09-4090-a6a4-883970cabc6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:21.857755 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.857709 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:42:19 +0000 UTC" deadline="2028-06-03 21:44:18.022830628 +0000 UTC" Sep 09 20:47:21.857755 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.857753 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15192h56m56.165082114s" Sep 09 20:47:21.882117 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.882089 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:21.882279 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.882230 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:21.882628 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.882610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:21.882713 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.882698 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:21.882766 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.882758 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:21.882855 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:21.882824 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:21.923282 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.923136 2580 generic.go:356] "Generic (PLEG): container finished" podID="72de7aab8a14ebc53b79cddbb9a80062" containerID="618c9c3fee73e4d80f5c2931d6658a04c0a0150018cf44621912dc701ac2ddbb" exitCode=0 Sep 09 20:47:21.924165 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:21.924139 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" event={"ID":"72de7aab8a14ebc53b79cddbb9a80062","Type":"ContainerDied","Data":"618c9c3fee73e4d80f5c2931d6658a04c0a0150018cf44621912dc701ac2ddbb"} Sep 09 20:47:22.947271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:22.947062 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" event={"ID":"72de7aab8a14ebc53b79cddbb9a80062","Type":"ContainerStarted","Data":"6f6b557d59fb735dfe6f02adc622679eb61aef3392b2e9a2f955616951bcf95e"} Sep 09 20:47:23.452894 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:23.452647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:23.453639 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.452843 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:23.453639 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.453244 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret podName:016e1f64-8347-482f-ba28-c31904328c16 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:27.453213438 +0000 UTC m=+10.055024992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret") pod "global-pull-secret-syncer-gfmr9" (UID: "016e1f64-8347-482f-ba28-c31904328c16") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:23.553620 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:23.553535 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:23.553620 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:23.553608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:23.553856 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.553779 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:47:23.553856 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.553799 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:47:23.553856 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.553811 2580 projected.go:196] Error preparing data for projected volume kube-api-access-cnh95 for pod openshift-network-diagnostics/network-check-target-4gczh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:23.553990 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.553869 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95 podName:2c84e099-4a09-4090-a6a4-883970cabc6f nodeName:}" failed. No retries permitted until 2026-09-09 20:47:27.553850076 +0000 UTC m=+10.155661631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnh95" (UniqueName: "kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95") pod "network-check-target-4gczh" (UID: "2c84e099-4a09-4090-a6a4-883970cabc6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:23.553990 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.553940 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:23.553990 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.553971 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:27.553961112 +0000 UTC m=+10.155772666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:23.880160 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:23.880127 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:23.880483 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.880294 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:23.880483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:23.880368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:23.880483 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:23.880453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:23.880483 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.880455 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:23.880704 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:23.880571 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:25.882215 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:25.882184 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:25.882721 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:25.882186 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:25.882721 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:25.882328 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:25.882721 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:25.882363 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:25.882721 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:25.882186 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:25.882721 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:25.882431 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:27.488528 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:27.488418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:27.488996 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.488587 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:27.488996 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.488683 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret podName:016e1f64-8347-482f-ba28-c31904328c16 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:35.488633619 +0000 UTC m=+18.090445191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret") pod "global-pull-secret-syncer-gfmr9" (UID: "016e1f64-8347-482f-ba28-c31904328c16") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:27.589415 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:27.589379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:27.589599 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:27.589447 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:27.589675 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.589610 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:47:27.589675 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.589630 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:47:27.589675 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.589644 2580 projected.go:196] Error preparing data for projected volume kube-api-access-cnh95 for pod openshift-network-diagnostics/network-check-target-4gczh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:27.589822 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.589713 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95 podName:2c84e099-4a09-4090-a6a4-883970cabc6f nodeName:}" failed. No retries permitted until 2026-09-09 20:47:35.589694123 +0000 UTC m=+18.191505674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnh95" (UniqueName: "kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95") pod "network-check-target-4gczh" (UID: "2c84e099-4a09-4090-a6a4-883970cabc6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:27.589822 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.589734 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:27.589822 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.589801 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:35.589782955 +0000 UTC m=+18.191594508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:27.882009 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:27.881668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:27.882009 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:27.881781 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:27.882009 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:27.881826 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:27.882009 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.881846 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:27.882009 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.881900 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:27.882009 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:27.881974 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:29.880537 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:29.880501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:29.881015 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:29.880501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:29.881015 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:29.880657 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:29.881015 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:29.880707 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:29.881015 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:29.880513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:29.881015 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:29.880860 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:31.880402 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:31.880362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:31.880873 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:31.880362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:31.880873 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:31.880518 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:31.880873 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:31.880530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:31.880873 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:31.880602 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:31.880873 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:31.880680 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:33.880142 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:33.880109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:33.880621 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:33.880109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:33.880621 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:33.880254 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:33.880621 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:33.880109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:33.880621 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:33.880377 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:33.880621 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:33.880495 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:35.547217 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:35.547178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:35.547729 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.547303 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:35.547729 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.547370 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret podName:016e1f64-8347-482f-ba28-c31904328c16 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:51.547353582 +0000 UTC m=+34.149165151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret") pod "global-pull-secret-syncer-gfmr9" (UID: "016e1f64-8347-482f-ba28-c31904328c16") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:35.648151 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:35.648110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:35.648308 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:35.648184 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:35.648308 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.648269 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:35.648438 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.648350 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:47:51.648329093 +0000 UTC m=+34.250140657 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:35.648438 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.648360 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:47:35.648438 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.648386 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:47:35.648438 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.648401 2580 projected.go:196] Error preparing data for projected volume kube-api-access-cnh95 for pod openshift-network-diagnostics/network-check-target-4gczh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:35.648644 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.648476 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95 podName:2c84e099-4a09-4090-a6a4-883970cabc6f nodeName:}" failed. No retries permitted until 2026-09-09 20:47:51.648446603 +0000 UTC m=+34.250258169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnh95" (UniqueName: "kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95") pod "network-check-target-4gczh" (UID: "2c84e099-4a09-4090-a6a4-883970cabc6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:35.880220 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:35.880140 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:35.880372 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:35.880140 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:35.880372 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.880270 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:35.880491 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.880374 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:35.880491 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:35.880145 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:35.880592 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:35.880500 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:37.881181 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:37.881103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:37.881658 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:37.881219 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:37.881658 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:37.881245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:37.881658 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:37.881274 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:37.881658 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:37.881346 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:37.881658 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:37.881431 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:38.981384 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.981202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b5495" event={"ID":"495b5948-934d-44e1-bc9d-4576e8a2bdf3","Type":"ContainerStarted","Data":"847802000fd093cce4f5202b7bb5a8643fa8ea37271ff8fc999711a428c017d3"} Sep 09 20:47:38.982827 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.982798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" event={"ID":"cdd74e32-7d21-4211-842b-199f04ae50dc","Type":"ContainerStarted","Data":"b1b312c2158aec08e49ddd142ffc456713ee3997acb434b76a1c98a76081c830"} Sep 09 20:47:38.984669 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.984643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" event={"ID":"3692b29f-5713-4b8f-8176-6edd683ed11b","Type":"ContainerStarted","Data":"46bead364794fab76c54a773ef0e8bc615014922ff68100ec46963e57d29d9e8"} Sep 09 20:47:38.984803 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.984701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" event={"ID":"3692b29f-5713-4b8f-8176-6edd683ed11b","Type":"ContainerStarted","Data":"7e279184ea66562c125f46c16bfb8cb47da057356f3dc466acdea4bf21632f26"} Sep 09 20:47:38.986071 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.986041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5kpxb" event={"ID":"0a385051-1f26-4c84-959c-7a561354e285","Type":"ContainerStarted","Data":"59fd0459ff04b1fbd419b36becd15759d954e151d59fc26d748d9b3b54bc9f8e"} Sep 09 20:47:38.987433 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.987365 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krxz8" event={"ID":"4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021","Type":"ContainerStarted","Data":"23246ece3210aa9646e9075d1c4fd9d943f486952f91aab84b9f9cf54628f006"} Sep 09 20:47:38.989190 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.989166 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c7lmx" event={"ID":"2d1561c7-7538-4e2f-906e-33004504e1bd","Type":"ContainerStarted","Data":"a45cde4f793767e3a7b3dc5fade62b53db87181c19bbb4965d42e9637151ac0e"} Sep 09 20:47:38.990877 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.990852 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e34bfd3-5f54-48e6-9be4-03ebabce312f" containerID="d501a3a45bc0d6294fc75207a95b39842bd67c0f654624f6e18dd1c0b430b0c4" exitCode=0 Sep 09 20:47:38.990991 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.990920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" event={"ID":"2e34bfd3-5f54-48e6-9be4-03ebabce312f","Type":"ContainerDied","Data":"d501a3a45bc0d6294fc75207a95b39842bd67c0f654624f6e18dd1c0b430b0c4"} Sep 09 20:47:38.992578 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:38.992552 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w5g8k" event={"ID":"4b2715ed-3169-453c-9ddb-3f9b9a31472d","Type":"ContainerStarted","Data":"541d3a6990a22f617f28ee39aa4d0bffd4d0789ad136218e298f0cabc435be75"} Sep 09 20:47:39.026244 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.026062 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-118.ec2.internal" podStartSLOduration=20.02604757 podStartE2EDuration="20.02604757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:22.962985187 +0000 UTC m=+5.564796758" watchObservedRunningTime="2026-09-09 20:47:39.02604757 +0000 UTC m=+21.627859140" Sep 09 20:47:39.026615 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.026579 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b5495" podStartSLOduration=4.190372897 podStartE2EDuration="22.026569865s" totalImagesPullingTime="17.836196968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:39.025611464 +0000 UTC m=+21.627423034" watchObservedRunningTime="2026-09-09 20:47:39.026569865 +0000 UTC m=+21.628381436" Sep 09 20:47:39.062960 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.062917 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5kpxb" podStartSLOduration=3.219540327 podStartE2EDuration="21.062891783s" totalImagesPullingTime="17.843351456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:39.062648873 +0000 UTC m=+21.664460470" watchObservedRunningTime="2026-09-09 20:47:39.062891783 +0000 UTC m=+21.664703354" Sep 09 20:47:39.122741 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.122695 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w5g8k" podStartSLOduration=3.2972132690000002 podStartE2EDuration="21.122677563s" totalImagesPullingTime="17.825464294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:39.121915736 +0000 UTC m=+21.723727308" watchObservedRunningTime="2026-09-09 20:47:39.122677563 +0000 UTC m=+21.724489135" Sep 09 20:47:39.152166 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.152124 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-krxz8" podStartSLOduration=7.311623191 podStartE2EDuration="21.152110649s" totalImagesPullingTime="13.840487458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:39.150871882 +0000 UTC m=+21.752683452" watchObservedRunningTime="2026-09-09 20:47:39.152110649 +0000 UTC m=+21.753922217" Sep 09 20:47:39.188238 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.188192 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c7lmx" podStartSLOduration=4.315419034 podStartE2EDuration="22.188176915s" totalImagesPullingTime="17.872757881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:39.187884235 +0000 UTC m=+21.789695806" watchObservedRunningTime="2026-09-09 20:47:39.188176915 +0000 UTC m=+21.789988482" Sep 09 20:47:39.847029 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.846997 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 20:47:39.849115 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.849071 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:39.849648 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.849618 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:39.876397 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.876290 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T20:47:39.84701674Z","UUID":"6348a774-b6f7-4eeb-aa7f-815663df07d1","Handler":null,"Name":"","Endpoint":""} Sep 09 20:47:39.877837 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.877806 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 20:47:39.877837 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.877841 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 20:47:39.880130 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.880085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:39.880254 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:39.880203 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:39.880254 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.880232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:39.880364 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.880292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:39.880522 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:39.880390 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:39.880581 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:39.880531 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:39.997384 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:39.997292 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" event={"ID":"cdd74e32-7d21-4211-842b-199f04ae50dc","Type":"ContainerStarted","Data":"9790bdeca15e87f414a8a0315d9c4e1453b64c7844cd5d5766f4b550b9618834"} Sep 09 20:47:40.000968 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:40.000938 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" event={"ID":"3692b29f-5713-4b8f-8176-6edd683ed11b","Type":"ContainerStarted","Data":"290b2aaa26ac2cca66c9485ed3d2a3d34e013871c10f4c5e705f87d9679ca28e"} Sep 09 20:47:40.001114 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:40.001017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" event={"ID":"3692b29f-5713-4b8f-8176-6edd683ed11b","Type":"ContainerStarted","Data":"a5d23a12638b1420891a38a88669e5f57fe3de5f732e30125ca5dc55a04e8ef0"} Sep 09 20:47:40.001114 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:40.001070 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" event={"ID":"3692b29f-5713-4b8f-8176-6edd683ed11b","Type":"ContainerStarted","Data":"e7af5cd30924fab8164dd9ac9c9ad3dd8fa8119359cd030af184c7de83eaa80a"} Sep 09 20:47:40.001114 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:40.001110 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" event={"ID":"3692b29f-5713-4b8f-8176-6edd683ed11b","Type":"ContainerStarted","Data":"fe7cc6993b6d01352d24c613f4714fa20d65467b2f441921e03321239f154be0"} Sep 09 20:47:41.005199 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:41.005157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vf2s7" event={"ID":"f45ffbf7-4819-48f2-82ab-8eb3842d6d19","Type":"ContainerStarted","Data":"8a3262796a07ce0dd86c253fff3179c70f53bd8c5e8c28e2683473039c10da9c"} Sep 09 20:47:41.005573 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:41.005204 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 20:47:41.020675 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:41.020600 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vf2s7" podStartSLOduration=5.185823602 podStartE2EDuration="23.020580573s" totalImagesPullingTime="17.834756971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:41.020302672 +0000 UTC m=+23.622114244" watchObservedRunningTime="2026-09-09 20:47:41.020580573 +0000 UTC m=+23.622392148" Sep 09 20:47:41.880375 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:41.880338 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:41.880576 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:41.880510 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:41.880576 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:41.880551 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:41.880701 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:41.880681 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:41.880758 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:41.880714 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:41.880811 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:41.880782 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:42.009903 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:42.009867 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" event={"ID":"cdd74e32-7d21-4211-842b-199f04ae50dc","Type":"ContainerStarted","Data":"7059debe53de1205ee60db672c3a25b26e7903167a55fdcb09be3221845f2196"} Sep 09 20:47:42.014058 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:42.014025 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" event={"ID":"3692b29f-5713-4b8f-8176-6edd683ed11b","Type":"ContainerStarted","Data":"d10c766eb2c98e9493e4a4e2869a53db6afd712e1c2b9a734017bfe2c8665940"} Sep 09 20:47:42.033654 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:42.033609 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kkcf" podStartSLOduration=4.240467173 podStartE2EDuration="24.033587441s" totalImagesPullingTime="19.793120268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:42.033286233 +0000 UTC m=+24.635097805" watchObservedRunningTime="2026-09-09 20:47:42.033587441 +0000 UTC m=+24.635399014" Sep 09 20:47:43.879878 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:43.879631 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:43.880518 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:43.879692 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:43.880518 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:43.879985 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:43.880518 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:43.879718 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:43.880518 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:43.880037 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:43.880518 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:43.880110 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:44.019712 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.019678 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e34bfd3-5f54-48e6-9be4-03ebabce312f" containerID="e25740585bef3f6bc9a68a5106312c8686b35f278591b8c38cf667ec369d4829" exitCode=0 Sep 09 20:47:44.019866 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.019763 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" event={"ID":"2e34bfd3-5f54-48e6-9be4-03ebabce312f","Type":"ContainerDied","Data":"e25740585bef3f6bc9a68a5106312c8686b35f278591b8c38cf667ec369d4829"} Sep 09 20:47:44.023847 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.023824 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" event={"ID":"3692b29f-5713-4b8f-8176-6edd683ed11b","Type":"ContainerStarted","Data":"ed0a46edad4bf527325fd76301b7b0a2cf89ebcd6d6f13b07a4e63df01258ab7"} Sep 09 20:47:44.026892 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.026514 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:44.027270 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.027246 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:44.027375 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.027325 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:44.042373 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.042350 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:44.042502 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.042445 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:47:44.072477 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.072415 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" podStartSLOduration=8.080365869 podStartE2EDuration="26.072401042s" totalImagesPullingTime="17.992035173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:44.071660719 +0000 UTC m=+26.673472290" watchObservedRunningTime="2026-09-09 20:47:44.072401042 +0000 UTC m=+26.674212613" Sep 09 20:47:44.380539 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.380501 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:44.380706 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.380627 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 20:47:44.381281 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:44.381261 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-krxz8" Sep 09 20:47:45.389352 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:45.389142 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gfmr9"] Sep 09 20:47:45.389931 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:45.389434 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:45.389931 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:45.389546 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:45.392051 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:45.392022 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9k7qt"] Sep 09 20:47:45.392388 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:45.392137 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:45.392388 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:45.392241 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:45.392750 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:45.392728 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4gczh"] Sep 09 20:47:45.392831 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:45.392820 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:45.392914 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:45.392898 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:46.030763 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:46.030731 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e34bfd3-5f54-48e6-9be4-03ebabce312f" containerID="35154b5efccfe5b0bbf087841aed41b82d454e027319da8187b8d236625fa2b5" exitCode=0 Sep 09 20:47:46.030926 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:46.030817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" event={"ID":"2e34bfd3-5f54-48e6-9be4-03ebabce312f","Type":"ContainerDied","Data":"35154b5efccfe5b0bbf087841aed41b82d454e027319da8187b8d236625fa2b5"} Sep 09 20:47:46.880340 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:46.880314 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:46.880665 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:46.880347 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:46.880665 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:46.880314 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:46.880665 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:46.880440 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:46.880665 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:46.880519 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:46.880665 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:46.880586 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:47.035691 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:47.035660 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e34bfd3-5f54-48e6-9be4-03ebabce312f" containerID="1987c8e6952e8c8901fb50e7466ad3ae7ef0984846742978f91acd78c574d056" exitCode=0 Sep 09 20:47:47.035839 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:47.035713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" event={"ID":"2e34bfd3-5f54-48e6-9be4-03ebabce312f","Type":"ContainerDied","Data":"1987c8e6952e8c8901fb50e7466ad3ae7ef0984846742978f91acd78c574d056"} Sep 09 20:47:48.880688 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:48.880491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:48.881083 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:48.880499 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:48.881083 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:48.880779 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:48.881083 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:48.880491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:48.881083 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:48.880842 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:48.881083 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:48.880975 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:50.879655 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:50.879606 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:50.880224 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:50.879613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:50.880224 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:50.879739 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:50.880224 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:50.879734 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4gczh" podUID="2c84e099-4a09-4090-a6a4-883970cabc6f" Sep 09 20:47:50.880224 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:50.879811 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gfmr9" podUID="016e1f64-8347-482f-ba28-c31904328c16" Sep 09 20:47:50.880224 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:50.879891 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:47:51.566616 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.566578 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:51.566825 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.566756 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:51.566895 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.566835 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret podName:016e1f64-8347-482f-ba28-c31904328c16 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:23.566814439 +0000 UTC m=+66.168625993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret") pod "global-pull-secret-syncer-gfmr9" (UID: "016e1f64-8347-482f-ba28-c31904328c16") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:47:51.642058 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.642028 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-118.ec2.internal" event="NodeReady" Sep 09 20:47:51.642233 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.642180 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 20:47:51.667894 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.667859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:51.668071 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.667944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:51.668071 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.668037 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:51.668071 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.668041 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:47:51.668071 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.668064 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:47:51.668257 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.668086 2580 projected.go:196] Error preparing data for projected volume kube-api-access-cnh95 for pod openshift-network-diagnostics/network-check-target-4gczh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:51.668257 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.668095 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:48:23.6680699 +0000 UTC m=+66.269881452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:47:51.668257 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.668137 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95 podName:2c84e099-4a09-4090-a6a4-883970cabc6f nodeName:}" failed. No retries permitted until 2026-09-09 20:48:23.66812085 +0000 UTC m=+66.269932420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cnh95" (UniqueName: "kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95") pod "network-check-target-4gczh" (UID: "2c84e099-4a09-4090-a6a4-883970cabc6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:47:51.679712 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.679685 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55558db468-jmqlw"] Sep 09 20:47:51.708842 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.708780 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-phb64"] Sep 09 20:47:51.709003 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.708956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.711895 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.711867 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 20:47:51.711895 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.711881 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 20:47:51.712103 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.711940 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nwrwc\"" Sep 09 20:47:51.712384 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.712347 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 20:47:51.720029 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.720008 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 20:47:51.724616 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.724592 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jfvbb"] Sep 09 20:47:51.724743 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.724711 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.727078 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.727013 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 20:47:51.727078 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.727028 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5nprp\"" Sep 09 20:47:51.727399 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.727384 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 20:47:51.742683 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.742654 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55558db468-jmqlw"] Sep 09 20:47:51.742792 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.742690 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jfvbb"] Sep 09 20:47:51.742792 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.742704 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-phb64"] Sep 09 20:47:51.742792 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.742786 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jfvbb" Sep 09 20:47:51.745950 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.745929 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bv8pc\"" Sep 09 20:47:51.746088 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.745962 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 20:47:51.746088 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.745987 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 20:47:51.746088 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.746004 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 20:47:51.768868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.768844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.768992 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.768875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-trusted-ca\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.768992 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.768905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-certificates\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.768992 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.768963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-installation-pull-secrets\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.769122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.769001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-image-registry-private-configuration\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.769122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.769058 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e2cc85-7409-4afa-b7d2-0ab48b7779be-ca-trust-extracted\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.769122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.769087 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzwqh\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-kube-api-access-zzwqh\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.769122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.769115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-bound-sa-token\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.869513 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvdqh\" (UniqueName: \"kubernetes.io/projected/03eae9a8-d21c-458c-94ee-d40ba126492d-kube-api-access-kvdqh\") pod \"ingress-canary-jfvbb\" (UID: \"03eae9a8-d21c-458c-94ee-d40ba126492d\") " pod="openshift-ingress-canary/ingress-canary-jfvbb" Sep 09 20:47:51.869688 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-tmp-dir\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.869688 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.869688 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-trusted-ca\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.869688 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-certificates\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.869688 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-config-volume\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.869934 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-installation-pull-secrets\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.869934 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmfcn\" (UniqueName: \"kubernetes.io/projected/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-kube-api-access-tmfcn\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.869934 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.869739 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:47:51.869934 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.869763 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55558db468-jmqlw: secret "image-registry-tls" not found Sep 09 20:47:51.869934 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-image-registry-private-configuration\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.869934 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e2cc85-7409-4afa-b7d2-0ab48b7779be-ca-trust-extracted\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.869934 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.869833 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls podName:30e2cc85-7409-4afa-b7d2-0ab48b7779be nodeName:}" failed. No retries permitted until 2026-09-09 20:47:52.369809814 +0000 UTC m=+34.971621380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls") pod "image-registry-55558db468-jmqlw" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be") : secret "image-registry-tls" not found Sep 09 20:47:51.869934 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzwqh\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-kube-api-access-zzwqh\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.869934 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869912 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.870341 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.869947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-bound-sa-token\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.870341 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.870004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03eae9a8-d21c-458c-94ee-d40ba126492d-cert\") pod \"ingress-canary-jfvbb\" (UID: \"03eae9a8-d21c-458c-94ee-d40ba126492d\") " pod="openshift-ingress-canary/ingress-canary-jfvbb" Sep 09 20:47:51.870341 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.870148 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e2cc85-7409-4afa-b7d2-0ab48b7779be-ca-trust-extracted\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.871133 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.871090 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-certificates\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.871133 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.871099 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-trusted-ca\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.874817 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.874795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-image-registry-private-configuration\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.874912 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.874817 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-installation-pull-secrets\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.881509 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.881453 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-bound-sa-token\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.883192 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.883171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzwqh\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-kube-api-access-zzwqh\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:51.970922 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.970882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-config-volume\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.971092 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.970929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmfcn\" (UniqueName: \"kubernetes.io/projected/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-kube-api-access-tmfcn\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.971165 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.971096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.971227 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.971168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03eae9a8-d21c-458c-94ee-d40ba126492d-cert\") pod \"ingress-canary-jfvbb\" (UID: \"03eae9a8-d21c-458c-94ee-d40ba126492d\") " pod="openshift-ingress-canary/ingress-canary-jfvbb" Sep 09 20:47:51.971227 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.971196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvdqh\" (UniqueName: \"kubernetes.io/projected/03eae9a8-d21c-458c-94ee-d40ba126492d-kube-api-access-kvdqh\") pod \"ingress-canary-jfvbb\" (UID: \"03eae9a8-d21c-458c-94ee-d40ba126492d\") " pod="openshift-ingress-canary/ingress-canary-jfvbb" Sep 09 20:47:51.971333 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.971226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-tmp-dir\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.971333 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.971283 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:47:51.971431 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:51.971345 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls podName:fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b nodeName:}" failed. No retries permitted until 2026-09-09 20:47:52.471328083 +0000 UTC m=+35.073139646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls") pod "dns-default-phb64" (UID: "fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b") : secret "dns-default-metrics-tls" not found Sep 09 20:47:51.971613 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.971584 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-config-volume\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.971613 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.971601 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-tmp-dir\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:51.973974 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.973952 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/03eae9a8-d21c-458c-94ee-d40ba126492d-cert\") pod \"ingress-canary-jfvbb\" (UID: \"03eae9a8-d21c-458c-94ee-d40ba126492d\") " pod="openshift-ingress-canary/ingress-canary-jfvbb" Sep 09 20:47:51.980150 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.980130 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvdqh\" (UniqueName: \"kubernetes.io/projected/03eae9a8-d21c-458c-94ee-d40ba126492d-kube-api-access-kvdqh\") pod \"ingress-canary-jfvbb\" (UID: \"03eae9a8-d21c-458c-94ee-d40ba126492d\") " pod="openshift-ingress-canary/ingress-canary-jfvbb" Sep 09 20:47:51.980378 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:51.980353 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmfcn\" (UniqueName: \"kubernetes.io/projected/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-kube-api-access-tmfcn\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:52.052548 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.052513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jfvbb" Sep 09 20:47:52.374556 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.374522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:52.374701 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:52.374640 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:47:52.374701 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:52.374653 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55558db468-jmqlw: secret "image-registry-tls" not found Sep 09 20:47:52.374770 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:52.374711 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls podName:30e2cc85-7409-4afa-b7d2-0ab48b7779be nodeName:}" failed. No retries permitted until 2026-09-09 20:47:53.374697794 +0000 UTC m=+35.976509342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls") pod "image-registry-55558db468-jmqlw" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be") : secret "image-registry-tls" not found Sep 09 20:47:52.475607 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.475583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:52.475750 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:52.475729 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:47:52.475801 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:52.475793 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls podName:fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b nodeName:}" failed. No retries permitted until 2026-09-09 20:47:53.475778345 +0000 UTC m=+36.077589898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls") pod "dns-default-phb64" (UID: "fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b") : secret "dns-default-metrics-tls" not found Sep 09 20:47:52.524185 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.524028 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jfvbb"] Sep 09 20:47:52.526266 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:47:52.526239 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03eae9a8_d21c_458c_94ee_d40ba126492d.slice/crio-0a436eec8d7422de7a7642acc256fb2318bbf04fc10254bb557eecbf5deeded7 WatchSource:0}: Error finding container 0a436eec8d7422de7a7642acc256fb2318bbf04fc10254bb557eecbf5deeded7: Status 404 returned error can't find the container with id 0a436eec8d7422de7a7642acc256fb2318bbf04fc10254bb557eecbf5deeded7 Sep 09 20:47:52.880046 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.880015 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:47:52.880222 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.880015 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:47:52.880222 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.880021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:47:52.882711 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.882689 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 20:47:52.883431 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.883410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 20:47:52.883568 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.883494 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 20:47:52.883568 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.883496 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 20:47:52.883662 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.883594 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzsmd\"" Sep 09 20:47:52.883713 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:52.883698 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-slrrp\"" Sep 09 20:47:53.052683 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:53.052643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jfvbb" event={"ID":"03eae9a8-d21c-458c-94ee-d40ba126492d","Type":"ContainerStarted","Data":"0a436eec8d7422de7a7642acc256fb2318bbf04fc10254bb557eecbf5deeded7"} Sep 09 20:47:53.055913 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:53.055885 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e34bfd3-5f54-48e6-9be4-03ebabce312f" containerID="5f86374e3b059cea1e86fafdd200d5f4986e8cb17c398ebf3259eec2578eede1" exitCode=0 Sep 09 20:47:53.056042 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:53.055929 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" event={"ID":"2e34bfd3-5f54-48e6-9be4-03ebabce312f","Type":"ContainerDied","Data":"5f86374e3b059cea1e86fafdd200d5f4986e8cb17c398ebf3259eec2578eede1"} Sep 09 20:47:53.384594 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:53.384513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:53.384747 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:53.384621 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:47:53.384747 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:53.384643 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55558db468-jmqlw: secret "image-registry-tls" not found Sep 09 20:47:53.384747 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:53.384713 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls podName:30e2cc85-7409-4afa-b7d2-0ab48b7779be nodeName:}" failed. No retries permitted until 2026-09-09 20:47:55.384691861 +0000 UTC m=+37.986503435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls") pod "image-registry-55558db468-jmqlw" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be") : secret "image-registry-tls" not found Sep 09 20:47:53.485620 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:53.485581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:53.485788 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:53.485738 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:47:53.485837 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:53.485799 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls podName:fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b nodeName:}" failed. No retries permitted until 2026-09-09 20:47:55.485785346 +0000 UTC m=+38.087596900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls") pod "dns-default-phb64" (UID: "fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b") : secret "dns-default-metrics-tls" not found Sep 09 20:47:54.063173 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:54.063135 2580 generic.go:356] "Generic (PLEG): container finished" podID="2e34bfd3-5f54-48e6-9be4-03ebabce312f" containerID="72c85827a8397154bc779dc425448345856e79e7a17958ec8ede9a44111d4dce" exitCode=0 Sep 09 20:47:54.063642 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:54.063188 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" event={"ID":"2e34bfd3-5f54-48e6-9be4-03ebabce312f","Type":"ContainerDied","Data":"72c85827a8397154bc779dc425448345856e79e7a17958ec8ede9a44111d4dce"} Sep 09 20:47:55.068945 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:55.068916 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" event={"ID":"2e34bfd3-5f54-48e6-9be4-03ebabce312f","Type":"ContainerStarted","Data":"49b6f6e1b90c94ba088c66840e9a21233e4964d5fe6d86f4a777409b0921b99e"} Sep 09 20:47:55.091565 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:55.091518 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t9hbd" podStartSLOduration=7.489454927 podStartE2EDuration="37.091500327s" totalImagesPullingTime="29.6020454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:55.09010706 +0000 UTC m=+37.691918655" watchObservedRunningTime="2026-09-09 20:47:55.091500327 +0000 UTC m=+37.693311898" Sep 09 20:47:55.401852 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:55.401819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:55.402016 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:55.401932 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:47:55.402016 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:55.401945 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55558db468-jmqlw: secret "image-registry-tls" not found Sep 09 20:47:55.402016 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:55.401996 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls podName:30e2cc85-7409-4afa-b7d2-0ab48b7779be nodeName:}" failed. No retries permitted until 2026-09-09 20:47:59.401983085 +0000 UTC m=+42.003794634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls") pod "image-registry-55558db468-jmqlw" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be") : secret "image-registry-tls" not found Sep 09 20:47:55.502441 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:55.502406 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:55.502601 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:55.502568 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:47:55.502649 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:55.502631 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls podName:fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b nodeName:}" failed. No retries permitted until 2026-09-09 20:47:59.502615912 +0000 UTC m=+42.104427465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls") pod "dns-default-phb64" (UID: "fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b") : secret "dns-default-metrics-tls" not found Sep 09 20:47:56.072447 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:56.072405 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jfvbb" event={"ID":"03eae9a8-d21c-458c-94ee-d40ba126492d","Type":"ContainerStarted","Data":"6b1ac2e628db0db84bb908cb221a7209abff08f2bc880b9e654266cdb42be35b"} Sep 09 20:47:56.085688 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:56.085636 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jfvbb" podStartSLOduration=2.599036254 podStartE2EDuration="5.085620057s" totalImagesPullingTime="2.486583803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:47:56.085023109 +0000 UTC m=+38.686834693" watchObservedRunningTime="2026-09-09 20:47:56.085620057 +0000 UTC m=+38.687431652" Sep 09 20:47:59.430941 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:59.430905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:47:59.431401 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:59.431050 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:47:59.431401 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:59.431068 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55558db468-jmqlw: secret "image-registry-tls" not found Sep 09 20:47:59.431401 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:59.431137 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls podName:30e2cc85-7409-4afa-b7d2-0ab48b7779be nodeName:}" failed. No retries permitted until 2026-09-09 20:48:07.431117721 +0000 UTC m=+50.032929292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls") pod "image-registry-55558db468-jmqlw" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be") : secret "image-registry-tls" not found Sep 09 20:47:59.532020 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:47:59.531981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:47:59.532125 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:59.532118 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:47:59.532178 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:47:59.532168 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls podName:fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b nodeName:}" failed. No retries permitted until 2026-09-09 20:48:07.53215522 +0000 UTC m=+50.133966769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls") pod "dns-default-phb64" (UID: "fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b") : secret "dns-default-metrics-tls" not found Sep 09 20:48:07.487648 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:07.487576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:48:07.488022 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:07.487718 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:48:07.488022 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:07.487738 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55558db468-jmqlw: secret "image-registry-tls" not found Sep 09 20:48:07.488022 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:07.487792 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls podName:30e2cc85-7409-4afa-b7d2-0ab48b7779be nodeName:}" failed. No retries permitted until 2026-09-09 20:48:23.48777663 +0000 UTC m=+66.089588183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls") pod "image-registry-55558db468-jmqlw" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be") : secret "image-registry-tls" not found Sep 09 20:48:07.588627 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:07.588599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:48:07.588758 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:07.588716 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:48:07.588796 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:07.588774 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls podName:fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b nodeName:}" failed. No retries permitted until 2026-09-09 20:48:23.588761053 +0000 UTC m=+66.190572607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls") pod "dns-default-phb64" (UID: "fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b") : secret "dns-default-metrics-tls" not found Sep 09 20:48:16.041758 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:16.041723 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jbjbj" Sep 09 20:48:23.501224 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.501163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:48:23.501755 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:23.501311 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:48:23.501755 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:23.501330 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55558db468-jmqlw: secret "image-registry-tls" not found Sep 09 20:48:23.501755 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:23.501394 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls podName:30e2cc85-7409-4afa-b7d2-0ab48b7779be nodeName:}" failed. No retries permitted until 2026-09-09 20:48:55.501372266 +0000 UTC m=+98.103183820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls") pod "image-registry-55558db468-jmqlw" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be") : secret "image-registry-tls" not found Sep 09 20:48:23.602299 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.602266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:48:23.602401 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.602305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:48:23.602442 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:23.602412 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:48:23.602507 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:23.602497 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls podName:fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b nodeName:}" failed. No retries permitted until 2026-09-09 20:48:55.602480812 +0000 UTC m=+98.204292375 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls") pod "dns-default-phb64" (UID: "fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b") : secret "dns-default-metrics-tls" not found Sep 09 20:48:23.604679 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.604662 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 20:48:23.616235 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.616216 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/016e1f64-8347-482f-ba28-c31904328c16-original-pull-secret\") pod \"global-pull-secret-syncer-gfmr9\" (UID: \"016e1f64-8347-482f-ba28-c31904328c16\") " pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:48:23.703528 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.703474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:48:23.703697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.703553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:48:23.705820 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.705798 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 20:48:23.705984 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.705964 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 20:48:23.714725 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:23.714701 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 20:48:23.714823 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:23.714794 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:49:27.714770682 +0000 UTC m=+130.316582246 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : secret "metrics-daemon-secret" not found Sep 09 20:48:23.716482 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.716452 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 20:48:23.727570 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.727552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnh95\" (UniqueName: \"kubernetes.io/projected/2c84e099-4a09-4090-a6a4-883970cabc6f-kube-api-access-cnh95\") pod \"network-check-target-4gczh\" (UID: \"2c84e099-4a09-4090-a6a4-883970cabc6f\") " pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:48:23.790799 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.790691 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gfmr9" Sep 09 20:48:23.803196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.803174 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzsmd\"" Sep 09 20:48:23.811079 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:23.811049 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:48:24.060196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:24.060165 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gfmr9"] Sep 09 20:48:24.062974 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:48:24.062946 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016e1f64_8347_482f_ba28_c31904328c16.slice/crio-83f7d6cd999dc145e3c8a0c6dc7dc0ef6376dc1ab6c63895c3d700ad7393b810 WatchSource:0}: Error finding container 83f7d6cd999dc145e3c8a0c6dc7dc0ef6376dc1ab6c63895c3d700ad7393b810: Status 404 returned error can't find the container with id 83f7d6cd999dc145e3c8a0c6dc7dc0ef6376dc1ab6c63895c3d700ad7393b810 Sep 09 20:48:24.083320 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:24.083294 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4gczh"] Sep 09 20:48:24.086237 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:48:24.086213 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c84e099_4a09_4090_a6a4_883970cabc6f.slice/crio-003333276c15c9cd8c650017de8a4c7aa5638812c6c2b73bcb902a103be3dc9b WatchSource:0}: Error finding container 003333276c15c9cd8c650017de8a4c7aa5638812c6c2b73bcb902a103be3dc9b: Status 404 returned error can't find the container with id 003333276c15c9cd8c650017de8a4c7aa5638812c6c2b73bcb902a103be3dc9b Sep 09 20:48:24.138428 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:24.138389 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gfmr9" event={"ID":"016e1f64-8347-482f-ba28-c31904328c16","Type":"ContainerStarted","Data":"83f7d6cd999dc145e3c8a0c6dc7dc0ef6376dc1ab6c63895c3d700ad7393b810"} Sep 09 20:48:24.139504 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:24.139479 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4gczh" event={"ID":"2c84e099-4a09-4090-a6a4-883970cabc6f","Type":"ContainerStarted","Data":"003333276c15c9cd8c650017de8a4c7aa5638812c6c2b73bcb902a103be3dc9b"} Sep 09 20:48:29.155816 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:29.155734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4gczh" event={"ID":"2c84e099-4a09-4090-a6a4-883970cabc6f","Type":"ContainerStarted","Data":"f5456629468b0fc5bb3baf88d3da497e38f5abf6c08ab1690b0382a9f18b377d"} Sep 09 20:48:29.156264 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:29.155851 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:48:29.157286 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:29.157263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gfmr9" event={"ID":"016e1f64-8347-482f-ba28-c31904328c16","Type":"ContainerStarted","Data":"1ec3f0ea431ccc632cffe37a92ef4434e0888631c4ee233c36296be35baa8847"} Sep 09 20:48:29.170823 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:29.170780 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4gczh" podStartSLOduration=66.454836568 podStartE2EDuration="1m11.170764339s" totalImagesPullingTime="4.715927771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:29.1697398 +0000 UTC m=+71.771551368" watchObservedRunningTime="2026-09-09 20:48:29.170764339 +0000 UTC m=+71.772575910" Sep 09 20:48:29.184510 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:29.184452 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gfmr9" podStartSLOduration=66.433720662 podStartE2EDuration="1m11.184439101s" totalImagesPullingTime="4.750718439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:29.183686633 +0000 UTC m=+71.785498223" watchObservedRunningTime="2026-09-09 20:48:29.184439101 +0000 UTC m=+71.786250671" Sep 09 20:48:48.326610 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.326490 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58"] Sep 09 20:48:48.329957 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.329939 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.335882 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.335528 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 09 20:48:48.336476 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.336441 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 09 20:48:48.336920 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.336891 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 09 20:48:48.337005 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.336947 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 09 20:48:48.337064 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.337012 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 20:48:48.337116 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.337010 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 20:48:48.337271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.336891 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 20:48:48.344920 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.344896 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58"] Sep 09 20:48:48.355166 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.355140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f74a7b96-3360-437a-9959-a91753ebf8ab-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.355270 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.355169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.355270 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.355193 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-hub\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.355270 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.355215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.355374 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.355296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnk4p\" (UniqueName: \"kubernetes.io/projected/f74a7b96-3360-437a-9959-a91753ebf8ab-kube-api-access-cnk4p\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.355374 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.355351 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-ca\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.455684 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.455623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnk4p\" (UniqueName: \"kubernetes.io/projected/f74a7b96-3360-437a-9959-a91753ebf8ab-kube-api-access-cnk4p\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.455869 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.455782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-ca\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.455869 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.455838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f74a7b96-3360-437a-9959-a91753ebf8ab-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.456031 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.455964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.456031 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.456023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-hub\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.456142 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.456051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.456636 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.456606 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f74a7b96-3360-437a-9959-a91753ebf8ab-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.458266 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.458238 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-ca\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.458400 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.458382 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.458568 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.458546 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-hub\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.458630 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.458564 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f74a7b96-3360-437a-9959-a91753ebf8ab-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.463947 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.463920 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnk4p\" (UniqueName: \"kubernetes.io/projected/f74a7b96-3360-437a-9959-a91753ebf8ab-kube-api-access-cnk4p\") pod \"cluster-proxy-proxy-agent-6d4fdd897f-jcp58\" (UID: \"f74a7b96-3360-437a-9959-a91753ebf8ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.642735 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.642650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:48:48.916320 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:48.916254 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58"] Sep 09 20:48:48.919322 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:48:48.919293 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf74a7b96_3360_437a_9959_a91753ebf8ab.slice/crio-5f01cc82742204b6a093f1959703528cf825473b5b626a7ce201ff9d97bdc7e6 WatchSource:0}: Error finding container 5f01cc82742204b6a093f1959703528cf825473b5b626a7ce201ff9d97bdc7e6: Status 404 returned error can't find the container with id 5f01cc82742204b6a093f1959703528cf825473b5b626a7ce201ff9d97bdc7e6 Sep 09 20:48:49.206004 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:49.205919 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" event={"ID":"f74a7b96-3360-437a-9959-a91753ebf8ab","Type":"ContainerStarted","Data":"5f01cc82742204b6a093f1959703528cf825473b5b626a7ce201ff9d97bdc7e6"} Sep 09 20:48:53.219949 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:53.219909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" event={"ID":"f74a7b96-3360-437a-9959-a91753ebf8ab","Type":"ContainerStarted","Data":"1b187696963ab2d83285eb33cabd8ab64e41aa6beb49399ab04765722b950acb"} Sep 09 20:48:53.220341 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:53.219963 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" event={"ID":"f74a7b96-3360-437a-9959-a91753ebf8ab","Type":"ContainerStarted","Data":"17a2817f8efacc7828e7d98c171e01815b16c1161e408a50c9512b9eae360586"} Sep 09 20:48:53.220341 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:53.219981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" event={"ID":"f74a7b96-3360-437a-9959-a91753ebf8ab","Type":"ContainerStarted","Data":"e88e040bcfb71b735eac0adc5b6989bb186b1fd7f03bbdda772b6208c783c856"} Sep 09 20:48:53.238807 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:53.238755 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" podStartSLOduration=1.554093817 podStartE2EDuration="5.238740155s" totalImagesPullingTime="3.684646338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:48:53.237656892 +0000 UTC m=+95.839468491" watchObservedRunningTime="2026-09-09 20:48:53.238740155 +0000 UTC m=+95.840551766" Sep 09 20:48:55.508226 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:55.508178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:48:55.508706 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:55.508302 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:48:55.508706 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:55.508315 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55558db468-jmqlw: secret "image-registry-tls" not found Sep 09 20:48:55.508706 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:55.508364 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls podName:30e2cc85-7409-4afa-b7d2-0ab48b7779be nodeName:}" failed. No retries permitted until 2026-09-09 20:49:59.508350326 +0000 UTC m=+162.110161876 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls") pod "image-registry-55558db468-jmqlw" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be") : secret "image-registry-tls" not found Sep 09 20:48:55.609187 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:48:55.609133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:48:55.609334 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:55.609287 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:48:55.609384 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:48:55.609354 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls podName:fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b nodeName:}" failed. No retries permitted until 2026-09-09 20:49:59.609337781 +0000 UTC m=+162.211149330 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls") pod "dns-default-phb64" (UID: "fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b") : secret "dns-default-metrics-tls" not found Sep 09 20:49:00.161600 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:49:00.161567 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4gczh" Sep 09 20:49:27.723016 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:49:27.722979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:49:27.723495 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:27.723096 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 20:49:27.723495 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:27.723156 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:29.723142794 +0000 UTC m=+252.324954348 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : secret "metrics-daemon-secret" not found Sep 09 20:49:54.722316 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:54.722272 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-55558db468-jmqlw" podUID="30e2cc85-7409-4afa-b7d2-0ab48b7779be" Sep 09 20:49:54.735479 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:54.735430 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-phb64" podUID="fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b" Sep 09 20:49:55.394872 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:49:55.394842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:49:55.395065 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:49:55.394842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phb64" Sep 09 20:49:55.895361 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:55.895318 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:49:59.542094 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:49:59.542051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") pod \"image-registry-55558db468-jmqlw\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:49:59.542724 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:59.542228 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:49:59.542724 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:59.542252 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55558db468-jmqlw: secret "image-registry-tls" not found Sep 09 20:49:59.542724 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:59.542343 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls podName:30e2cc85-7409-4afa-b7d2-0ab48b7779be nodeName:}" failed. No retries permitted until 2026-09-09 20:52:01.542321009 +0000 UTC m=+284.144132573 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls") pod "image-registry-55558db468-jmqlw" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be") : secret "image-registry-tls" not found Sep 09 20:49:59.643390 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:49:59.643356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:49:59.643579 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:59.643541 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:49:59.643647 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:49:59.643626 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls podName:fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b nodeName:}" failed. No retries permitted until 2026-09-09 20:52:01.643604956 +0000 UTC m=+284.245416513 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls") pod "dns-default-phb64" (UID: "fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b") : secret "dns-default-metrics-tls" not found Sep 09 20:50:10.880290 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:50:10.880198 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:51:29.770688 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:29.770630 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:51:29.771189 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:29.770782 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 20:51:29.771189 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:29.770847 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs podName:baaab02f-8a89-400e-a327-f5d48b6907b5 nodeName:}" failed. No retries permitted until 2026-09-09 20:53:31.770830077 +0000 UTC m=+374.372641630 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs") pod "network-metrics-daemon-9k7qt" (UID: "baaab02f-8a89-400e-a327-f5d48b6907b5") : secret "metrics-daemon-secret" not found Sep 09 20:51:37.084766 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.084733 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4s5v5"] Sep 09 20:51:37.086660 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.086644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.089313 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.089285 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 20:51:37.089434 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.089290 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 20:51:37.089434 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.089331 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 20:51:37.089434 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.089350 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 20:51:37.090179 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.090161 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x54bc\"" Sep 09 20:51:37.099514 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.099493 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4s5v5"] Sep 09 20:51:37.222898 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.222871 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.223029 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.222929 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8927115b-a57a-4aaa-acab-10b966ca1fd6-data-volume\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.223029 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.222947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kcbj\" (UniqueName: \"kubernetes.io/projected/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-api-access-5kcbj\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.223029 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.222963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8927115b-a57a-4aaa-acab-10b966ca1fd6-crio-socket\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.223029 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.222985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.323567 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.323532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8927115b-a57a-4aaa-acab-10b966ca1fd6-data-volume\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.323567 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.323572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kcbj\" (UniqueName: \"kubernetes.io/projected/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-api-access-5kcbj\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.323703 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.323588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8927115b-a57a-4aaa-acab-10b966ca1fd6-crio-socket\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.323703 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.323610 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.323703 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.323680 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8927115b-a57a-4aaa-acab-10b966ca1fd6-crio-socket\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.323703 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:37.323694 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:51:37.323861 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:37.323745 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:37.823732917 +0000 UTC m=+260.425544470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:51:37.323861 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.323761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.323861 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:37.323826 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:51:37.323962 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:37.323874 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:37.823861073 +0000 UTC m=+260.425672638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : configmap "kube-rbac-proxy" not found Sep 09 20:51:37.323962 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.323907 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8927115b-a57a-4aaa-acab-10b966ca1fd6-data-volume\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.332192 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.332168 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kcbj\" (UniqueName: \"kubernetes.io/projected/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-api-access-5kcbj\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.827756 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.827724 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.827947 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:37.827775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:37.827947 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:37.827869 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:51:37.827947 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:37.827886 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:51:37.827947 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:37.827922 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:38.827905875 +0000 UTC m=+261.429717444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : configmap "kube-rbac-proxy" not found Sep 09 20:51:37.828113 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:37.827955 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:38.827936426 +0000 UTC m=+261.429747980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:51:38.834632 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:38.834602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:38.835019 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:38.834657 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:38.835019 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:38.834744 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:51:38.835019 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:38.834752 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:51:38.835019 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:38.834789 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:40.834777563 +0000 UTC m=+263.436589111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : configmap "kube-rbac-proxy" not found Sep 09 20:51:38.835019 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:38.834802 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:40.834795361 +0000 UTC m=+263.436606910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:51:39.049750 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:39.049724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w5g8k_4b2715ed-3169-453c-9ddb-3f9b9a31472d/dns-node-resolver/0.log" Sep 09 20:51:39.848204 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:39.848176 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5kpxb_0a385051-1f26-4c84-959c-7a561354e285/node-ca/0.log" Sep 09 20:51:40.848389 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:40.848359 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jfvbb_03eae9a8-d21c-458c-94ee-d40ba126492d/serve-healthcheck-canary/0.log" Sep 09 20:51:40.850585 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:40.850562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:40.850674 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:40.850616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:40.850718 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:40.850682 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:51:40.850718 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:40.850700 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:51:40.850789 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:40.850748 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:44.850734189 +0000 UTC m=+267.452545738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : configmap "kube-rbac-proxy" not found Sep 09 20:51:40.850789 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:40.850763 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:44.850755735 +0000 UTC m=+267.452567283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:51:44.879689 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:44.879655 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:44.880186 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:44.879707 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:44.880186 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:44.879784 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:51:44.880186 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:44.879810 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:51:44.880186 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:44.879847 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:52.879830305 +0000 UTC m=+275.481641853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : configmap "kube-rbac-proxy" not found Sep 09 20:51:44.880186 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:44.879876 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls podName:8927115b-a57a-4aaa-acab-10b966ca1fd6 nodeName:}" failed. No retries permitted until 2026-09-09 20:51:52.879856346 +0000 UTC m=+275.481667895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4s5v5" (UID: "8927115b-a57a-4aaa-acab-10b966ca1fd6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:51:52.936829 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:52.936794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:52.937281 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:52.936849 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:52.937328 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:52.937286 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8927115b-a57a-4aaa-acab-10b966ca1fd6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:52.939084 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:52.939056 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8927115b-a57a-4aaa-acab-10b966ca1fd6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4s5v5\" (UID: \"8927115b-a57a-4aaa-acab-10b966ca1fd6\") " pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:52.995118 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:52.995091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4s5v5" Sep 09 20:51:53.269098 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:53.269028 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4s5v5"] Sep 09 20:51:53.272230 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:51:53.272206 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8927115b_a57a_4aaa_acab_10b966ca1fd6.slice/crio-d29a69e5827868de84897d4ff82d249dd6a5772caa1e26b2348f1be01a4cde05 WatchSource:0}: Error finding container d29a69e5827868de84897d4ff82d249dd6a5772caa1e26b2348f1be01a4cde05: Status 404 returned error can't find the container with id d29a69e5827868de84897d4ff82d249dd6a5772caa1e26b2348f1be01a4cde05 Sep 09 20:51:53.719967 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:53.719935 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s5v5" event={"ID":"8927115b-a57a-4aaa-acab-10b966ca1fd6","Type":"ContainerStarted","Data":"9fe7da028dc9a9df263e3ed94436633e2100c073743c027cd4c9af91bce171de"} Sep 09 20:51:53.720138 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:53.719989 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s5v5" event={"ID":"8927115b-a57a-4aaa-acab-10b966ca1fd6","Type":"ContainerStarted","Data":"d29a69e5827868de84897d4ff82d249dd6a5772caa1e26b2348f1be01a4cde05"} Sep 09 20:51:54.728060 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:54.728027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s5v5" event={"ID":"8927115b-a57a-4aaa-acab-10b966ca1fd6","Type":"ContainerStarted","Data":"9663d6dd1c53b238e79ff48d14d24e5d22e5db5a71b8ed0a79316d1326884871"} Sep 09 20:51:56.735382 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:56.735340 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4s5v5" event={"ID":"8927115b-a57a-4aaa-acab-10b966ca1fd6","Type":"ContainerStarted","Data":"907bf375a7ac989b9e86edc1e53a919ac1c2c6572357cd526334230611b48c62"} Sep 09 20:51:56.761185 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:56.761132 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4s5v5" podStartSLOduration=17.44101969 podStartE2EDuration="19.761115855s" totalImagesPullingTime="2.320096165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:51:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:51:56.759959768 +0000 UTC m=+279.361771338" watchObservedRunningTime="2026-09-09 20:51:56.761115855 +0000 UTC m=+279.362927425" Sep 09 20:51:58.396051 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:58.395989 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-phb64" podUID="fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b" Sep 09 20:51:58.396051 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:58.395989 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-55558db468-jmqlw" podUID="30e2cc85-7409-4afa-b7d2-0ab48b7779be" Sep 09 20:51:58.490239 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:58.490202 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55558db468-jmqlw"] Sep 09 20:51:58.741607 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:58.741527 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phb64" Sep 09 20:51:58.741607 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:58.741552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:51:58.741913 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:51:58.741895 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-55558db468-jmqlw" podUID="30e2cc85-7409-4afa-b7d2-0ab48b7779be" Sep 09 20:51:59.044732 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.044695 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-6g2z2"] Sep 09 20:51:59.047670 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.047649 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-6g2z2" Sep 09 20:51:59.050141 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.050117 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 20:51:59.050260 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.050121 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sk89c\"" Sep 09 20:51:59.050260 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.050157 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 20:51:59.060750 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.060728 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-6g2z2"] Sep 09 20:51:59.078815 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.078791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgz8h\" (UniqueName: \"kubernetes.io/projected/a38c71bb-2f39-43f9-90f4-2a1444f6e9a9-kube-api-access-mgz8h\") pod \"downloads-85d98c998f-6g2z2\" (UID: \"a38c71bb-2f39-43f9-90f4-2a1444f6e9a9\") " pod="openshift-console/downloads-85d98c998f-6g2z2" Sep 09 20:51:59.180189 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.180140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgz8h\" (UniqueName: \"kubernetes.io/projected/a38c71bb-2f39-43f9-90f4-2a1444f6e9a9-kube-api-access-mgz8h\") pod \"downloads-85d98c998f-6g2z2\" (UID: \"a38c71bb-2f39-43f9-90f4-2a1444f6e9a9\") " pod="openshift-console/downloads-85d98c998f-6g2z2" Sep 09 20:51:59.188118 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.188092 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgz8h\" (UniqueName: \"kubernetes.io/projected/a38c71bb-2f39-43f9-90f4-2a1444f6e9a9-kube-api-access-mgz8h\") pod \"downloads-85d98c998f-6g2z2\" (UID: \"a38c71bb-2f39-43f9-90f4-2a1444f6e9a9\") " pod="openshift-console/downloads-85d98c998f-6g2z2" Sep 09 20:51:59.356480 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.356362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-6g2z2" Sep 09 20:51:59.625905 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.625820 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-6g2z2"] Sep 09 20:51:59.628553 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:51:59.628530 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38c71bb_2f39_43f9_90f4_2a1444f6e9a9.slice/crio-9fd0bf05aabdf63f06722a36a98761b75dca5cf7aabef30699e937500eef13e6 WatchSource:0}: Error finding container 9fd0bf05aabdf63f06722a36a98761b75dca5cf7aabef30699e937500eef13e6: Status 404 returned error can't find the container with id 9fd0bf05aabdf63f06722a36a98761b75dca5cf7aabef30699e937500eef13e6 Sep 09 20:51:59.748729 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.748697 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:51:59.748729 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.748708 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-6g2z2" event={"ID":"a38c71bb-2f39-43f9-90f4-2a1444f6e9a9","Type":"ContainerStarted","Data":"9fd0bf05aabdf63f06722a36a98761b75dca5cf7aabef30699e937500eef13e6"} Sep 09 20:51:59.756203 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.756181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:51:59.784781 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.784758 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzwqh\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-kube-api-access-zzwqh\") pod \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " Sep 09 20:51:59.784953 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.784799 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-image-registry-private-configuration\") pod \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " Sep 09 20:51:59.784953 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.784826 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e2cc85-7409-4afa-b7d2-0ab48b7779be-ca-trust-extracted\") pod \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " Sep 09 20:51:59.784953 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.784860 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-trusted-ca\") pod \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " Sep 09 20:51:59.784953 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.784895 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-installation-pull-secrets\") pod \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " Sep 09 20:51:59.784953 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.784939 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-bound-sa-token\") pod \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " Sep 09 20:51:59.785201 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.784967 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-certificates\") pod \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\" (UID: \"30e2cc85-7409-4afa-b7d2-0ab48b7779be\") " Sep 09 20:51:59.785256 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.785222 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30e2cc85-7409-4afa-b7d2-0ab48b7779be-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "30e2cc85-7409-4afa-b7d2-0ab48b7779be" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:51:59.785419 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.785393 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "30e2cc85-7409-4afa-b7d2-0ab48b7779be" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:51:59.785530 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.785486 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "30e2cc85-7409-4afa-b7d2-0ab48b7779be" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:51:59.787271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.787216 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "30e2cc85-7409-4afa-b7d2-0ab48b7779be" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:51:59.787389 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.787297 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "30e2cc85-7409-4afa-b7d2-0ab48b7779be" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:51:59.787389 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.787355 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "30e2cc85-7409-4afa-b7d2-0ab48b7779be" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:51:59.787488 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.787414 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-kube-api-access-zzwqh" (OuterVolumeSpecName: "kube-api-access-zzwqh") pod "30e2cc85-7409-4afa-b7d2-0ab48b7779be" (UID: "30e2cc85-7409-4afa-b7d2-0ab48b7779be"). InnerVolumeSpecName "kube-api-access-zzwqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:51:59.885424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.885352 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e2cc85-7409-4afa-b7d2-0ab48b7779be-ca-trust-extracted\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:51:59.885424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.885375 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-trusted-ca\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:51:59.885424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.885383 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-installation-pull-secrets\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:51:59.885424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.885393 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-bound-sa-token\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:51:59.885424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.885402 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-certificates\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:51:59.885424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.885410 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzwqh\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-kube-api-access-zzwqh\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:51:59.885424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:51:59.885419 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e2cc85-7409-4afa-b7d2-0ab48b7779be-image-registry-private-configuration\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:00.752032 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:00.752003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55558db468-jmqlw" Sep 09 20:52:00.778895 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:00.778870 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55558db468-jmqlw"] Sep 09 20:52:00.782598 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:00.782575 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55558db468-jmqlw"] Sep 09 20:52:00.791129 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:00.791113 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e2cc85-7409-4afa-b7d2-0ab48b7779be-registry-tls\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:01.698635 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:01.698598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:52:01.701092 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:01.701055 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b-metrics-tls\") pod \"dns-default-phb64\" (UID: \"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b\") " pod="openshift-dns/dns-default-phb64" Sep 09 20:52:01.744046 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:01.744018 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5nprp\"" Sep 09 20:52:01.752925 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:01.752893 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-phb64" Sep 09 20:52:01.884920 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:01.884888 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30e2cc85-7409-4afa-b7d2-0ab48b7779be" path="/var/lib/kubelet/pods/30e2cc85-7409-4afa-b7d2-0ab48b7779be/volumes" Sep 09 20:52:02.038506 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:02.038432 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-phb64"] Sep 09 20:52:02.040999 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:52:02.040974 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa718c5e_e3f5_4a17_95c2_a01eb79c7f1b.slice/crio-b8b14bd80577bc71364a14d287bd7924d7283d5a0956fb1aec54425f33d68ef9 WatchSource:0}: Error finding container b8b14bd80577bc71364a14d287bd7924d7283d5a0956fb1aec54425f33d68ef9: Status 404 returned error can't find the container with id b8b14bd80577bc71364a14d287bd7924d7283d5a0956fb1aec54425f33d68ef9 Sep 09 20:52:02.760452 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:02.760414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phb64" event={"ID":"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b","Type":"ContainerStarted","Data":"b8b14bd80577bc71364a14d287bd7924d7283d5a0956fb1aec54425f33d68ef9"} Sep 09 20:52:04.768451 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:04.768415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phb64" event={"ID":"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b","Type":"ContainerStarted","Data":"203d7a5b040ed1d47cf6a5fe9c2d53f84b719af875fe408389c85ab92dda7e74"} Sep 09 20:52:04.768886 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:04.768495 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-phb64" event={"ID":"fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b","Type":"ContainerStarted","Data":"94da13d85af35a213bb16e497bbf05d9a288d22f98be4a5301955d2b5c74bead"} Sep 09 20:52:04.768886 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:04.768603 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-phb64" Sep 09 20:52:04.786637 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:04.786584 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-phb64" podStartSLOduration=252.021037383 podStartE2EDuration="4m13.786566165s" totalImagesPullingTime="1.765528782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:04.785753287 +0000 UTC m=+287.387564859" watchObservedRunningTime="2026-09-09 20:52:04.786566165 +0000 UTC m=+287.388377738" Sep 09 20:52:06.971142 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:06.971107 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f9c6d97cd-crj92"] Sep 09 20:52:06.974543 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:06.974522 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:06.977958 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:06.977929 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-swtmt\"" Sep 09 20:52:06.977958 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:06.977945 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 20:52:06.978127 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:06.977929 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 20:52:06.978127 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:06.977989 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 20:52:06.978127 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:06.977929 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 20:52:06.978127 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:06.977930 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 20:52:06.986285 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:06.986265 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9c6d97cd-crj92"] Sep 09 20:52:07.038609 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.038577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-serving-cert\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.038732 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.038654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmd52\" (UniqueName: \"kubernetes.io/projected/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-kube-api-access-gmd52\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.038732 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.038686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-oauth-config\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.038732 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.038710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-oauth-serving-cert\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.038873 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.038761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-service-ca\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.038873 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.038801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-config\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.114686 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.114655 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm"] Sep 09 20:52:07.117541 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.117518 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" Sep 09 20:52:07.119503 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.119481 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 09 20:52:07.119789 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.119773 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hc2vf\"" Sep 09 20:52:07.126537 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.126477 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm"] Sep 09 20:52:07.139554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.139531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-oauth-config\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.139643 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.139566 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-oauth-serving-cert\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.139643 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.139593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-service-ca\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.139643 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.139627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-config\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.139794 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.139659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-serving-cert\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.139794 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.139694 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a5668d2-7fcc-4a35-bb92-c39172e61535-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xmtlm\" (UID: \"8a5668d2-7fcc-4a35-bb92-c39172e61535\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" Sep 09 20:52:07.139794 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.139758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmd52\" (UniqueName: \"kubernetes.io/projected/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-kube-api-access-gmd52\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.140491 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.140431 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-config\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.140491 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.140455 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-service-ca\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.140630 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.140478 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-oauth-serving-cert\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.142295 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.142274 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-oauth-config\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.142433 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.142411 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-serving-cert\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.147185 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.147149 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmd52\" (UniqueName: \"kubernetes.io/projected/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-kube-api-access-gmd52\") pod \"console-7f9c6d97cd-crj92\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.240330 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.240272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a5668d2-7fcc-4a35-bb92-c39172e61535-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xmtlm\" (UID: \"8a5668d2-7fcc-4a35-bb92-c39172e61535\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" Sep 09 20:52:07.240438 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:52:07.240369 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 09 20:52:07.240438 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:52:07.240436 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5668d2-7fcc-4a35-bb92-c39172e61535-tls-certificates podName:8a5668d2-7fcc-4a35-bb92-c39172e61535 nodeName:}" failed. No retries permitted until 2026-09-09 20:52:07.74041736 +0000 UTC m=+290.342228924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8a5668d2-7fcc-4a35-bb92-c39172e61535-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-xmtlm" (UID: "8a5668d2-7fcc-4a35-bb92-c39172e61535") : secret "prometheus-operator-admission-webhook-tls" not found Sep 09 20:52:07.285689 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.285655 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:07.564806 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.564776 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9c6d97cd-crj92"] Sep 09 20:52:07.568378 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:52:07.568347 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc38e05_d2c6_4e4e_a13c_43e5fe8b1a56.slice/crio-76c0924972b6b0a46db68280fbe1d7f9f1d38c0afcba205009e558e9995c2bda WatchSource:0}: Error finding container 76c0924972b6b0a46db68280fbe1d7f9f1d38c0afcba205009e558e9995c2bda: Status 404 returned error can't find the container with id 76c0924972b6b0a46db68280fbe1d7f9f1d38c0afcba205009e558e9995c2bda Sep 09 20:52:07.745215 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.745172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a5668d2-7fcc-4a35-bb92-c39172e61535-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xmtlm\" (UID: \"8a5668d2-7fcc-4a35-bb92-c39172e61535\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" Sep 09 20:52:07.747811 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.747784 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a5668d2-7fcc-4a35-bb92-c39172e61535-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-xmtlm\" (UID: \"8a5668d2-7fcc-4a35-bb92-c39172e61535\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" Sep 09 20:52:07.781252 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:07.781210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9c6d97cd-crj92" event={"ID":"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56","Type":"ContainerStarted","Data":"76c0924972b6b0a46db68280fbe1d7f9f1d38c0afcba205009e558e9995c2bda"} Sep 09 20:52:08.028611 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:08.028530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" Sep 09 20:52:08.306314 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:08.306280 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm"] Sep 09 20:52:08.309425 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:52:08.309389 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5668d2_7fcc_4a35_bb92_c39172e61535.slice/crio-4d69eb6f7ae509dda9f25c5a3f905a77fad45081a9030911f5787a0f9a089527 WatchSource:0}: Error finding container 4d69eb6f7ae509dda9f25c5a3f905a77fad45081a9030911f5787a0f9a089527: Status 404 returned error can't find the container with id 4d69eb6f7ae509dda9f25c5a3f905a77fad45081a9030911f5787a0f9a089527 Sep 09 20:52:08.786858 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:08.786778 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" event={"ID":"8a5668d2-7fcc-4a35-bb92-c39172e61535","Type":"ContainerStarted","Data":"4d69eb6f7ae509dda9f25c5a3f905a77fad45081a9030911f5787a0f9a089527"} Sep 09 20:52:13.881205 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:52:13.881157 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9k7qt" podUID="baaab02f-8a89-400e-a327-f5d48b6907b5" Sep 09 20:52:14.774797 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:14.774767 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-phb64" Sep 09 20:52:16.338690 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.338659 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57666bcbfd-4gxsd"] Sep 09 20:52:16.344534 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.344514 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.353122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.352723 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 20:52:16.353736 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.353712 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57666bcbfd-4gxsd"] Sep 09 20:52:16.423101 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.423064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-serving-cert\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.423281 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.423122 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-trusted-ca-bundle\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.423281 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.423204 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kcnk\" (UniqueName: \"kubernetes.io/projected/80e09881-2f27-4336-b72f-932a75c7e44c-kube-api-access-5kcnk\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.423281 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.423252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-oauth-serving-cert\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.423281 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.423276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-service-ca\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.423502 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.423345 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-oauth-config\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.423502 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.423401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-console-config\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.524564 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.524525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kcnk\" (UniqueName: \"kubernetes.io/projected/80e09881-2f27-4336-b72f-932a75c7e44c-kube-api-access-5kcnk\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.524727 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.524578 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-oauth-serving-cert\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.524727 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.524606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-service-ca\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.524727 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.524660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-oauth-config\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.524727 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.524697 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-console-config\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.524727 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.524725 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-serving-cert\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.525034 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.524769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-trusted-ca-bundle\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.525480 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.525430 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-oauth-serving-cert\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.525612 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.525488 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-console-config\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.525612 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.525484 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-service-ca\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.525732 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.525714 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-trusted-ca-bundle\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.527367 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.527343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-serving-cert\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.527657 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.527636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-oauth-config\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.532205 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.532181 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kcnk\" (UniqueName: \"kubernetes.io/projected/80e09881-2f27-4336-b72f-932a75c7e44c-kube-api-access-5kcnk\") pod \"console-57666bcbfd-4gxsd\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:16.656410 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:16.656325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:17.820255 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.820169 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9c6d97cd-crj92" event={"ID":"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56","Type":"ContainerStarted","Data":"3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432"} Sep 09 20:52:17.822025 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.821993 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-6g2z2" event={"ID":"a38c71bb-2f39-43f9-90f4-2a1444f6e9a9","Type":"ContainerStarted","Data":"b52918b0da79178ec7390f468196bb1b5ce3d55486d8d589c99a88b4b915b9cc"} Sep 09 20:52:17.822375 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.822341 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-6g2z2" Sep 09 20:52:17.824405 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.824100 2580 patch_prober.go:28] interesting pod/downloads-85d98c998f-6g2z2 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.11:8080/\": dial tcp 10.133.0.11:8080: connect: connection refused" start-of-body= Sep 09 20:52:17.824405 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.824163 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-6g2z2" podUID="a38c71bb-2f39-43f9-90f4-2a1444f6e9a9" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.11:8080/\": dial tcp 10.133.0.11:8080: connect: connection refused" Sep 09 20:52:17.825374 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.825310 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" event={"ID":"8a5668d2-7fcc-4a35-bb92-c39172e61535","Type":"ContainerStarted","Data":"b6f46823ac93110c6fbc96b0c69a6c33698506b1f64263a26fed68dd9c83ca62"} Sep 09 20:52:17.825945 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.825890 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" Sep 09 20:52:17.832106 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.832086 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" Sep 09 20:52:17.838403 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.838385 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 20:52:17.840485 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.840430 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f9c6d97cd-crj92" podStartSLOduration=1.836359088 podStartE2EDuration="11.840418258s" totalImagesPullingTime="10.00405917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:17.83919214 +0000 UTC m=+300.441003713" watchObservedRunningTime="2026-09-09 20:52:17.840418258 +0000 UTC m=+300.442229820" Sep 09 20:52:17.847343 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.847316 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57666bcbfd-4gxsd"] Sep 09 20:52:17.851387 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:52:17.851363 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e09881_2f27_4336_b72f_932a75c7e44c.slice/crio-eb98a153816a7b20c7b713d04547a6c4c4a72b205ac6a3a0c23cf0ccd0d96eaf WatchSource:0}: Error finding container eb98a153816a7b20c7b713d04547a6c4c4a72b205ac6a3a0c23cf0ccd0d96eaf: Status 404 returned error can't find the container with id eb98a153816a7b20c7b713d04547a6c4c4a72b205ac6a3a0c23cf0ccd0d96eaf Sep 09 20:52:17.858994 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.858954 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-6g2z2" podStartSLOduration=0.848818988 podStartE2EDuration="18.858936533s" totalImagesPullingTime="18.010117545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:17.857932205 +0000 UTC m=+300.459743777" watchObservedRunningTime="2026-09-09 20:52:17.858936533 +0000 UTC m=+300.460748105" Sep 09 20:52:17.880116 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:17.872761 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-xmtlm" podStartSLOduration=1.617746204 podStartE2EDuration="10.872743279s" totalImagesPullingTime="9.254997075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:17.872133486 +0000 UTC m=+300.473945038" watchObservedRunningTime="2026-09-09 20:52:17.872743279 +0000 UTC m=+300.474554851" Sep 09 20:52:18.831123 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:18.831075 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57666bcbfd-4gxsd" event={"ID":"80e09881-2f27-4336-b72f-932a75c7e44c","Type":"ContainerStarted","Data":"6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708"} Sep 09 20:52:18.831595 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:18.831198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57666bcbfd-4gxsd" event={"ID":"80e09881-2f27-4336-b72f-932a75c7e44c","Type":"ContainerStarted","Data":"eb98a153816a7b20c7b713d04547a6c4c4a72b205ac6a3a0c23cf0ccd0d96eaf"} Sep 09 20:52:18.849757 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:18.849725 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-6g2z2" Sep 09 20:52:18.853083 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:18.853033 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57666bcbfd-4gxsd" podStartSLOduration=2.853014986 podStartE2EDuration="2.853014986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:18.851640754 +0000 UTC m=+301.453452325" watchObservedRunningTime="2026-09-09 20:52:18.853014986 +0000 UTC m=+301.454826557" Sep 09 20:52:22.571273 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.571237 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj"] Sep 09 20:52:22.623430 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.623390 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj"] Sep 09 20:52:22.623663 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.623450 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mlm4r"] Sep 09 20:52:22.623663 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.623581 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.626644 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.626611 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 20:52:22.626795 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.626679 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 20:52:22.626952 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.626929 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-82qrn\"" Sep 09 20:52:22.627080 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.626929 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 20:52:22.627668 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.627639 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 20:52:22.627766 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.627684 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 20:52:22.642547 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.642519 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.644985 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.644963 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgk6b\"" Sep 09 20:52:22.645114 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.645009 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 20:52:22.645114 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.645097 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 20:52:22.645228 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.645210 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 20:52:22.778920 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.778879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/214979d4-f25c-4443-870a-e19e549756ad-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.779166 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.778931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/680768b6-404c-4858-a243-0ecab888c5d3-sys\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.779166 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.778955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680768b6-404c-4858-a243-0ecab888c5d3-metrics-client-ca\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.779166 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-textfile\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.779166 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-wtmp\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.779166 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.779166 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj8kc\" (UniqueName: \"kubernetes.io/projected/680768b6-404c-4858-a243-0ecab888c5d3-kube-api-access-xj8kc\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.779420 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779208 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/214979d4-f25c-4443-870a-e19e549756ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.779420 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/680768b6-404c-4858-a243-0ecab888c5d3-root\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.779420 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779278 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.779420 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-tls\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.779420 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/214979d4-f25c-4443-870a-e19e549756ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.779420 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.779378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5s5x\" (UniqueName: \"kubernetes.io/projected/214979d4-f25c-4443-870a-e19e549756ad-kube-api-access-m5s5x\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.880488 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-wtmp\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.880488 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.880488 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj8kc\" (UniqueName: \"kubernetes.io/projected/680768b6-404c-4858-a243-0ecab888c5d3-kube-api-access-xj8kc\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.880791 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/214979d4-f25c-4443-870a-e19e549756ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.880791 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/680768b6-404c-4858-a243-0ecab888c5d3-root\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.880791 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880613 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.880791 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880617 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-wtmp\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.880791 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-tls\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.880791 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:52:22.880682 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 09 20:52:22.880791 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880693 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/680768b6-404c-4858-a243-0ecab888c5d3-root\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.880791 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:52:22.880749 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/214979d4-f25c-4443-870a-e19e549756ad-openshift-state-metrics-tls podName:214979d4-f25c-4443-870a-e19e549756ad nodeName:}" failed. No retries permitted until 2026-09-09 20:52:23.380730976 +0000 UTC m=+305.982542537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/214979d4-f25c-4443-870a-e19e549756ad-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-pnvqj" (UID: "214979d4-f25c-4443-870a-e19e549756ad") : secret "openshift-state-metrics-tls" not found Sep 09 20:52:22.881196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/214979d4-f25c-4443-870a-e19e549756ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.881196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880870 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5s5x\" (UniqueName: \"kubernetes.io/projected/214979d4-f25c-4443-870a-e19e549756ad-kube-api-access-m5s5x\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.881196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/214979d4-f25c-4443-870a-e19e549756ad-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.881196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/680768b6-404c-4858-a243-0ecab888c5d3-sys\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.881196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.880970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680768b6-404c-4858-a243-0ecab888c5d3-metrics-client-ca\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.881196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.881003 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-textfile\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.881196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.881148 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/680768b6-404c-4858-a243-0ecab888c5d3-sys\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.881578 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.881284 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-textfile\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.881578 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.881318 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.881736 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.881702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/680768b6-404c-4858-a243-0ecab888c5d3-metrics-client-ca\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.881964 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.881923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/214979d4-f25c-4443-870a-e19e549756ad-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.883414 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.883392 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-tls\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.883549 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.883480 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/680768b6-404c-4858-a243-0ecab888c5d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.883862 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.883840 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/214979d4-f25c-4443-870a-e19e549756ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.889351 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.889325 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj8kc\" (UniqueName: \"kubernetes.io/projected/680768b6-404c-4858-a243-0ecab888c5d3-kube-api-access-xj8kc\") pod \"node-exporter-mlm4r\" (UID: \"680768b6-404c-4858-a243-0ecab888c5d3\") " pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.889709 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.889687 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5s5x\" (UniqueName: \"kubernetes.io/projected/214979d4-f25c-4443-870a-e19e549756ad-kube-api-access-m5s5x\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:22.953282 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.953249 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mlm4r" Sep 09 20:52:22.992710 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:52:22.992672 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680768b6_404c_4858_a243_0ecab888c5d3.slice/crio-c712570d49bb74e7b209aca9f7986af02ee13b7e63d4c80df30d5a8b78d61e08 WatchSource:0}: Error finding container c712570d49bb74e7b209aca9f7986af02ee13b7e63d4c80df30d5a8b78d61e08: Status 404 returned error can't find the container with id c712570d49bb74e7b209aca9f7986af02ee13b7e63d4c80df30d5a8b78d61e08 Sep 09 20:52:22.994832 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:22.994809 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:52:23.385939 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.385896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/214979d4-f25c-4443-870a-e19e549756ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:23.388665 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.388640 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/214979d4-f25c-4443-870a-e19e549756ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-pnvqj\" (UID: \"214979d4-f25c-4443-870a-e19e549756ad\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:23.534710 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.534670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" Sep 09 20:52:23.713882 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.713799 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:52:23.737342 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.737308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.740906 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.740870 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:52:23.741553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.741527 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 20:52:23.744650 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.744622 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 20:52:23.745084 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.744880 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 20:52:23.745084 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.745073 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 20:52:23.745207 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.745196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 20:52:23.745424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.745347 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 20:52:23.745789 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.745453 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 20:52:23.745789 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.745599 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j8srp\"" Sep 09 20:52:23.746041 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.745353 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 20:52:23.746406 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.746345 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 20:52:23.843759 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.843671 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj"] Sep 09 20:52:23.848044 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:52:23.848009 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214979d4_f25c_4443_870a_e19e549756ad.slice/crio-2ff5c46296f3d04e5da845548b33b87aa8b218ca1148f0d483a58685ab90b9c5 WatchSource:0}: Error finding container 2ff5c46296f3d04e5da845548b33b87aa8b218ca1148f0d483a58685ab90b9c5: Status 404 returned error can't find the container with id 2ff5c46296f3d04e5da845548b33b87aa8b218ca1148f0d483a58685ab90b9c5 Sep 09 20:52:23.852398 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.852362 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlm4r" event={"ID":"680768b6-404c-4858-a243-0ecab888c5d3","Type":"ContainerStarted","Data":"c712570d49bb74e7b209aca9f7986af02ee13b7e63d4c80df30d5a8b78d61e08"} Sep 09 20:52:23.889009 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.888977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889133 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889022 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889133 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-out\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889133 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889316 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889316 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889417 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889328 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv5qq\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-kube-api-access-bv5qq\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889512 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889484 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889583 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889554 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889636 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889687 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889733 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-web-config\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.889733 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.889720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.990631 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.990595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.990821 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.990647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.990821 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.990671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.991403 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.991447 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-web-config\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.991968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.992057 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.992090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.992115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-out\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.992157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.992188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.992214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.992238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv5qq\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-kube-api-access-bv5qq\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.992869 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993882 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.993366 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.993882 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.993784 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.994484 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.994421 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.994942 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.994903 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.995652 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.995608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.999352 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.998679 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-out\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:23.999352 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:23.998864 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:24.000376 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.000331 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-volume\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:24.000504 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.000400 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:24.000504 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.000412 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-web-config\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:24.003100 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.003057 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:24.004554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.004507 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv5qq\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-kube-api-access-bv5qq\") pod \"alertmanager-main-0\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:24.052528 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.052492 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:52:24.703088 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.703057 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:52:24.838411 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:52:24.838370 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6925be7f_c0f5_4123_85ea_42dcbf5073d9.slice/crio-0906e3dd193526a873768a2b0bd77fbe43363d1557ef5cf9d38924d445cb0c6e WatchSource:0}: Error finding container 0906e3dd193526a873768a2b0bd77fbe43363d1557ef5cf9d38924d445cb0c6e: Status 404 returned error can't find the container with id 0906e3dd193526a873768a2b0bd77fbe43363d1557ef5cf9d38924d445cb0c6e Sep 09 20:52:24.861168 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.861115 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" event={"ID":"214979d4-f25c-4443-870a-e19e549756ad","Type":"ContainerStarted","Data":"2d3f1a3531b0cc3aa002cc7d56114337f3f3cd587ef98aa03fa9070b2218a55e"} Sep 09 20:52:24.861422 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.861200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" event={"ID":"214979d4-f25c-4443-870a-e19e549756ad","Type":"ContainerStarted","Data":"14e51debccaa37b8b57b40a511717c99ff7b2add30fb10d0b00ca3062bc09392"} Sep 09 20:52:24.861422 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.861231 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" event={"ID":"214979d4-f25c-4443-870a-e19e549756ad","Type":"ContainerStarted","Data":"2ff5c46296f3d04e5da845548b33b87aa8b218ca1148f0d483a58685ab90b9c5"} Sep 09 20:52:24.863008 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:24.862978 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerStarted","Data":"0906e3dd193526a873768a2b0bd77fbe43363d1557ef5cf9d38924d445cb0c6e"} Sep 09 20:52:25.869811 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:25.869766 2580 generic.go:356] "Generic (PLEG): container finished" podID="680768b6-404c-4858-a243-0ecab888c5d3" containerID="9382a2762c2ca94841519b270a848db46f36872d3bae7683d8914309f21d27c2" exitCode=0 Sep 09 20:52:25.870246 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:25.869826 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlm4r" event={"ID":"680768b6-404c-4858-a243-0ecab888c5d3","Type":"ContainerDied","Data":"9382a2762c2ca94841519b270a848db46f36872d3bae7683d8914309f21d27c2"} Sep 09 20:52:26.656828 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.656777 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:26.656999 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.656868 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:26.662221 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.662193 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:26.876601 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.876555 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" event={"ID":"214979d4-f25c-4443-870a-e19e549756ad","Type":"ContainerStarted","Data":"76e9baf3c8fe9ae987ed06fcf7d5b0d64a720c9119d4e8232ef604a0a00feec1"} Sep 09 20:52:26.879223 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.879187 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlm4r" event={"ID":"680768b6-404c-4858-a243-0ecab888c5d3","Type":"ContainerStarted","Data":"b1f9d17f9289f3afa5c6d358488a36944815654e074e74215228dc959926c3fc"} Sep 09 20:52:26.879359 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.879250 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlm4r" event={"ID":"680768b6-404c-4858-a243-0ecab888c5d3","Type":"ContainerStarted","Data":"b99ed5684cd443ea36e5d6ec5f1e425fa37634631dbc765089ecf1f982b3d51d"} Sep 09 20:52:26.881114 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.881001 2580 generic.go:356] "Generic (PLEG): container finished" podID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerID="dd9069312891c25513d0025b0ea16ce360cef064dc974e70b02c48cde952adc5" exitCode=0 Sep 09 20:52:26.881114 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.881033 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerDied","Data":"dd9069312891c25513d0025b0ea16ce360cef064dc974e70b02c48cde952adc5"} Sep 09 20:52:26.885678 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.885659 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:52:26.892700 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.892660 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-pnvqj" podStartSLOduration=2.737761149 podStartE2EDuration="4.892646753s" totalImagesPullingTime="2.154885604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:26.892399183 +0000 UTC m=+309.494210755" watchObservedRunningTime="2026-09-09 20:52:26.892646753 +0000 UTC m=+309.494458318" Sep 09 20:52:26.927977 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.927887 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mlm4r" podStartSLOduration=2.968199836 podStartE2EDuration="4.927870558s" totalImagesPullingTime="1.861457969s" totalInitContainerRuntime="98.212753ms" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:26.926769539 +0000 UTC m=+309.528581116" watchObservedRunningTime="2026-09-09 20:52:26.927870558 +0000 UTC m=+309.529682128" Sep 09 20:52:26.932387 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:26.932363 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f9c6d97cd-crj92"] Sep 09 20:52:27.286182 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.286108 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:27.561781 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.561749 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b95964594-hb8lm"] Sep 09 20:52:27.585757 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.585729 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b95964594-hb8lm"] Sep 09 20:52:27.585923 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.585849 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.726113 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.726074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-serving-cert\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.726303 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.726177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-oauth-config\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.726303 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.726221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-console-config\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.726303 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.726299 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-service-ca\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.726490 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.726372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-oauth-serving-cert\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.726490 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.726405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbpdr\" (UniqueName: \"kubernetes.io/projected/8f56d55c-71ab-4834-86fe-848836e965c9-kube-api-access-jbpdr\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.726490 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.726443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-trusted-ca-bundle\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.826964 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.826873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-serving-cert\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.826964 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.826953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-oauth-config\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.827172 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.826979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-console-config\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.827172 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.827039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-service-ca\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.827172 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.827071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-oauth-serving-cert\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.827172 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.827093 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbpdr\" (UniqueName: \"kubernetes.io/projected/8f56d55c-71ab-4834-86fe-848836e965c9-kube-api-access-jbpdr\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.827172 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.827123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-trusted-ca-bundle\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.827916 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.827878 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-console-config\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.828020 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.827879 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-oauth-serving-cert\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.828020 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.827950 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-trusted-ca-bundle\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.828020 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.827968 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-service-ca\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.829641 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.829620 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-oauth-config\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.829872 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.829850 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-serving-cert\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.835732 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.835711 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbpdr\" (UniqueName: \"kubernetes.io/projected/8f56d55c-71ab-4834-86fe-848836e965c9-kube-api-access-jbpdr\") pod \"console-b95964594-hb8lm\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:27.881054 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.881030 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:52:27.896644 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:27.896619 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:28.529232 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:28.529164 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b95964594-hb8lm"] Sep 09 20:52:28.575241 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:52:28.575209 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f56d55c_71ab_4834_86fe_848836e965c9.slice/crio-7f6d19bc11cc781e782952988a7aef2d21666d8645ba884a8c38099675250c33 WatchSource:0}: Error finding container 7f6d19bc11cc781e782952988a7aef2d21666d8645ba884a8c38099675250c33: Status 404 returned error can't find the container with id 7f6d19bc11cc781e782952988a7aef2d21666d8645ba884a8c38099675250c33 Sep 09 20:52:28.889212 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:28.889174 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerStarted","Data":"f71ae6b9a2ee25ac837115cc9ac285a4cbb2fd7ce4922bc704a2bf01b1a571de"} Sep 09 20:52:28.889558 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:28.889251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerStarted","Data":"6ac99afa322219b5662dfed3da37053a871a7fdb58ce067d036fdc95e6d2609c"} Sep 09 20:52:28.890697 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:28.890669 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95964594-hb8lm" event={"ID":"8f56d55c-71ab-4834-86fe-848836e965c9","Type":"ContainerStarted","Data":"ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914"} Sep 09 20:52:28.890782 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:28.890717 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95964594-hb8lm" event={"ID":"8f56d55c-71ab-4834-86fe-848836e965c9","Type":"ContainerStarted","Data":"7f6d19bc11cc781e782952988a7aef2d21666d8645ba884a8c38099675250c33"} Sep 09 20:52:28.915530 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:28.915489 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b95964594-hb8lm" podStartSLOduration=1.915457615 podStartE2EDuration="1.915457615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:28.915142872 +0000 UTC m=+311.516954443" watchObservedRunningTime="2026-09-09 20:52:28.915457615 +0000 UTC m=+311.517269186" Sep 09 20:52:29.898244 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:29.898208 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerStarted","Data":"04f8d13dcd927ee15998a3ed9fd96f182ed4464d713eb42c5079f73731d40f2b"} Sep 09 20:52:29.898768 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:29.898290 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerStarted","Data":"25066a4348bb3e675ac6d07f809edc9f4d1d20e46046c67dda14759cf47b7bc4"} Sep 09 20:52:29.898768 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:29.898338 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerStarted","Data":"9dc202bfabf5740fd324cf67c6014996ccf14d47f8ae8b12bc0cd08827b7f736"} Sep 09 20:52:30.905325 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:30.905292 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerStarted","Data":"d05bff48b84a9d72158caf45888e82aa03fb37b47458b8cd730ca8552a417135"} Sep 09 20:52:30.935977 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:30.935919 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.146291733 podStartE2EDuration="7.935904238s" totalImagesPullingTime="4.761011226s" totalInitContainerRuntime="28.601279ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:30.933996673 +0000 UTC m=+313.535808243" watchObservedRunningTime="2026-09-09 20:52:30.935904238 +0000 UTC m=+313.537715813" Sep 09 20:52:32.216129 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.216090 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b95964594-hb8lm"] Sep 09 20:52:32.250065 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.250039 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-699587656-zq4pt"] Sep 09 20:52:32.273496 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.273473 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699587656-zq4pt"] Sep 09 20:52:32.273630 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.273555 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.364342 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.364312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-service-ca\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.364342 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.364345 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-serving-cert\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.364575 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.364380 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-config\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.364575 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.364453 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-oauth-serving-cert\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.364575 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.364509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-trusted-ca-bundle\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.364575 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.364533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5hz\" (UniqueName: \"kubernetes.io/projected/83620516-a6b9-4015-911b-4afbdc1ed9ec-kube-api-access-gp5hz\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.364727 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.364583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-oauth-config\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.465731 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.465700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-serving-cert\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.465817 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.465743 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-config\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.465817 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.465762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-oauth-serving-cert\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.465817 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.465780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-trusted-ca-bundle\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.465817 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.465798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5hz\" (UniqueName: \"kubernetes.io/projected/83620516-a6b9-4015-911b-4afbdc1ed9ec-kube-api-access-gp5hz\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.465962 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.465843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-oauth-config\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.465962 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.465904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-service-ca\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.466558 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.466501 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-config\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.466700 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.466675 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-oauth-serving-cert\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.466852 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.466829 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-trusted-ca-bundle\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.466918 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.466847 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-service-ca\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.468288 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.468262 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-serving-cert\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.468418 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.468396 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-oauth-config\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.474312 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.474290 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5hz\" (UniqueName: \"kubernetes.io/projected/83620516-a6b9-4015-911b-4afbdc1ed9ec-kube-api-access-gp5hz\") pod \"console-699587656-zq4pt\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.582261 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.582235 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:32.883864 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.883837 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699587656-zq4pt"] Sep 09 20:52:32.886712 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:52:32.886678 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83620516_a6b9_4015_911b_4afbdc1ed9ec.slice/crio-4b33facc16cb574d4ca3a8d9f2b2a2fd3b86fb0b7c2da0741ed7aa288f69f4e2 WatchSource:0}: Error finding container 4b33facc16cb574d4ca3a8d9f2b2a2fd3b86fb0b7c2da0741ed7aa288f69f4e2: Status 404 returned error can't find the container with id 4b33facc16cb574d4ca3a8d9f2b2a2fd3b86fb0b7c2da0741ed7aa288f69f4e2 Sep 09 20:52:32.915013 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:32.914982 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699587656-zq4pt" event={"ID":"83620516-a6b9-4015-911b-4afbdc1ed9ec","Type":"ContainerStarted","Data":"4b33facc16cb574d4ca3a8d9f2b2a2fd3b86fb0b7c2da0741ed7aa288f69f4e2"} Sep 09 20:52:33.920230 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:33.920198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699587656-zq4pt" event={"ID":"83620516-a6b9-4015-911b-4afbdc1ed9ec","Type":"ContainerStarted","Data":"bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e"} Sep 09 20:52:33.940087 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:33.940040 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-699587656-zq4pt" podStartSLOduration=1.9400250799999998 podStartE2EDuration="1.94002508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:52:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:33.938265589 +0000 UTC m=+316.540077159" watchObservedRunningTime="2026-09-09 20:52:33.94002508 +0000 UTC m=+316.541836647" Sep 09 20:52:37.896878 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:37.896845 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:42.583373 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:42.583319 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:42.583843 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:42.583395 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:42.588135 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:42.588103 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:42.955725 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:42.955640 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-699587656-zq4pt" Sep 09 20:52:43.007292 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:43.007256 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57666bcbfd-4gxsd"] Sep 09 20:52:48.644319 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:48.644275 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" podUID="f74a7b96-3360-437a-9959-a91753ebf8ab" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 20:52:51.951519 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:51.951435 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f9c6d97cd-crj92" podUID="9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" containerName="console" containerID="cri-o://3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432" gracePeriod=15 Sep 09 20:52:52.219399 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.219318 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:52.324126 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324088 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-config\") pod \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " Sep 09 20:52:52.324323 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324144 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-oauth-serving-cert\") pod \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " Sep 09 20:52:52.324323 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324176 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-service-ca\") pod \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " Sep 09 20:52:52.324323 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324201 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmd52\" (UniqueName: \"kubernetes.io/projected/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-kube-api-access-gmd52\") pod \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " Sep 09 20:52:52.324501 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324331 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-serving-cert\") pod \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " Sep 09 20:52:52.324501 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324395 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-oauth-config\") pod \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\" (UID: \"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56\") " Sep 09 20:52:52.324612 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324587 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-config" (OuterVolumeSpecName: "console-config") pod "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" (UID: "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:52:52.324655 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324601 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" (UID: "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:52:52.324655 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324616 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-service-ca" (OuterVolumeSpecName: "service-ca") pod "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" (UID: "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:52:52.324730 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324695 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-service-ca\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:52.324730 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324715 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:52.324730 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.324727 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-oauth-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:52.326673 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.326649 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" (UID: "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:52:52.326758 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.326744 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-kube-api-access-gmd52" (OuterVolumeSpecName: "kube-api-access-gmd52") pod "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" (UID: "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56"). InnerVolumeSpecName "kube-api-access-gmd52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:52:52.326798 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.326779 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" (UID: "9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:52:52.425723 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.425683 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-oauth-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:52.425723 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.425713 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmd52\" (UniqueName: \"kubernetes.io/projected/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-kube-api-access-gmd52\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:52.425723 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.425723 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56-console-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:52.988507 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.988449 2580 generic.go:356] "Generic (PLEG): container finished" podID="9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" containerID="3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432" exitCode=0 Sep 09 20:52:52.988919 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.988533 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9c6d97cd-crj92" Sep 09 20:52:52.988919 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.988535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9c6d97cd-crj92" event={"ID":"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56","Type":"ContainerDied","Data":"3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432"} Sep 09 20:52:52.988919 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.988587 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9c6d97cd-crj92" event={"ID":"9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56","Type":"ContainerDied","Data":"76c0924972b6b0a46db68280fbe1d7f9f1d38c0afcba205009e558e9995c2bda"} Sep 09 20:52:52.988919 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:52.988616 2580 scope.go:117] "RemoveContainer" containerID="3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432" Sep 09 20:52:53.009751 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:53.009726 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f9c6d97cd-crj92"] Sep 09 20:52:53.009876 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:53.009758 2580 scope.go:117] "RemoveContainer" containerID="3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432" Sep 09 20:52:53.010115 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:52:53.010095 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432\": container with ID starting with 3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432 not found: ID does not exist" containerID="3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432" Sep 09 20:52:53.010179 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:53.010129 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432"} err="failed to get container status \"3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432\": rpc error: code = NotFound desc = could not find container \"3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432\": container with ID starting with 3df8350f191773351c28cc0afc3a68e3c0844bc51067014457af0921f4a05432 not found: ID does not exist" Sep 09 20:52:53.011999 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:53.011977 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f9c6d97cd-crj92"] Sep 09 20:52:53.885145 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:53.885108 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" path="/var/lib/kubelet/pods/9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56/volumes" Sep 09 20:52:57.235240 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.235195 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b95964594-hb8lm" podUID="8f56d55c-71ab-4834-86fe-848836e965c9" containerName="console" containerID="cri-o://ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914" gracePeriod=15 Sep 09 20:52:57.503384 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.503315 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:57.570091 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570060 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-oauth-serving-cert\") pod \"8f56d55c-71ab-4834-86fe-848836e965c9\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " Sep 09 20:52:57.570269 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570101 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-serving-cert\") pod \"8f56d55c-71ab-4834-86fe-848836e965c9\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " Sep 09 20:52:57.570269 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570118 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-trusted-ca-bundle\") pod \"8f56d55c-71ab-4834-86fe-848836e965c9\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " Sep 09 20:52:57.570269 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570159 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-oauth-config\") pod \"8f56d55c-71ab-4834-86fe-848836e965c9\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " Sep 09 20:52:57.570438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570281 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-console-config\") pod \"8f56d55c-71ab-4834-86fe-848836e965c9\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " Sep 09 20:52:57.570438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570334 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-service-ca\") pod \"8f56d55c-71ab-4834-86fe-848836e965c9\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " Sep 09 20:52:57.570438 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570360 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbpdr\" (UniqueName: \"kubernetes.io/projected/8f56d55c-71ab-4834-86fe-848836e965c9-kube-api-access-jbpdr\") pod \"8f56d55c-71ab-4834-86fe-848836e965c9\" (UID: \"8f56d55c-71ab-4834-86fe-848836e965c9\") " Sep 09 20:52:57.570669 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570556 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8f56d55c-71ab-4834-86fe-848836e965c9" (UID: "8f56d55c-71ab-4834-86fe-848836e965c9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:52:57.570739 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570605 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8f56d55c-71ab-4834-86fe-848836e965c9" (UID: "8f56d55c-71ab-4834-86fe-848836e965c9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:52:57.570794 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570741 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-oauth-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:57.570794 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570765 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-trusted-ca-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:57.570868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570820 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-service-ca" (OuterVolumeSpecName: "service-ca") pod "8f56d55c-71ab-4834-86fe-848836e965c9" (UID: "8f56d55c-71ab-4834-86fe-848836e965c9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:52:57.570868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.570827 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-console-config" (OuterVolumeSpecName: "console-config") pod "8f56d55c-71ab-4834-86fe-848836e965c9" (UID: "8f56d55c-71ab-4834-86fe-848836e965c9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:52:57.572283 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.572264 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8f56d55c-71ab-4834-86fe-848836e965c9" (UID: "8f56d55c-71ab-4834-86fe-848836e965c9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:52:57.572860 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.572831 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8f56d55c-71ab-4834-86fe-848836e965c9" (UID: "8f56d55c-71ab-4834-86fe-848836e965c9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:52:57.572941 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.572855 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f56d55c-71ab-4834-86fe-848836e965c9-kube-api-access-jbpdr" (OuterVolumeSpecName: "kube-api-access-jbpdr") pod "8f56d55c-71ab-4834-86fe-848836e965c9" (UID: "8f56d55c-71ab-4834-86fe-848836e965c9"). InnerVolumeSpecName "kube-api-access-jbpdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:52:57.671226 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.671191 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:57.671226 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.671220 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f56d55c-71ab-4834-86fe-848836e965c9-console-oauth-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:57.671226 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.671229 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-console-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:57.671440 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.671239 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f56d55c-71ab-4834-86fe-848836e965c9-service-ca\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:57.671440 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:57.671247 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbpdr\" (UniqueName: \"kubernetes.io/projected/8f56d55c-71ab-4834-86fe-848836e965c9-kube-api-access-jbpdr\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:52:58.010581 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.010543 2580 generic.go:356] "Generic (PLEG): container finished" podID="8f56d55c-71ab-4834-86fe-848836e965c9" containerID="ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914" exitCode=0 Sep 09 20:52:58.010760 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.010606 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b95964594-hb8lm" Sep 09 20:52:58.010760 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.010625 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95964594-hb8lm" event={"ID":"8f56d55c-71ab-4834-86fe-848836e965c9","Type":"ContainerDied","Data":"ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914"} Sep 09 20:52:58.010760 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.010716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b95964594-hb8lm" event={"ID":"8f56d55c-71ab-4834-86fe-848836e965c9","Type":"ContainerDied","Data":"7f6d19bc11cc781e782952988a7aef2d21666d8645ba884a8c38099675250c33"} Sep 09 20:52:58.010760 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.010747 2580 scope.go:117] "RemoveContainer" containerID="ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914" Sep 09 20:52:58.025243 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.025227 2580 scope.go:117] "RemoveContainer" containerID="ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914" Sep 09 20:52:58.025520 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:52:58.025496 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914\": container with ID starting with ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914 not found: ID does not exist" containerID="ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914" Sep 09 20:52:58.025585 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.025529 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914"} err="failed to get container status \"ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914\": rpc error: code = NotFound desc = could not find container \"ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914\": container with ID starting with ebcd7132506c5d15fcece5d11d346dd8d2bfd6da88081822ee69ce154cbc2914 not found: ID does not exist" Sep 09 20:52:58.035892 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.035871 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b95964594-hb8lm"] Sep 09 20:52:58.040368 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.040343 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b95964594-hb8lm"] Sep 09 20:52:58.644119 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:58.644065 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" podUID="f74a7b96-3360-437a-9959-a91753ebf8ab" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 20:52:59.884404 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:52:59.884370 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f56d55c-71ab-4834-86fe-848836e965c9" path="/var/lib/kubelet/pods/8f56d55c-71ab-4834-86fe-848836e965c9/volumes" Sep 09 20:53:08.027105 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.027057 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57666bcbfd-4gxsd" podUID="80e09881-2f27-4336-b72f-932a75c7e44c" containerName="console" containerID="cri-o://6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708" gracePeriod=15 Sep 09 20:53:08.263311 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.263287 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:53:08.350191 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350160 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-serving-cert\") pod \"80e09881-2f27-4336-b72f-932a75c7e44c\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " Sep 09 20:53:08.350343 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350192 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-trusted-ca-bundle\") pod \"80e09881-2f27-4336-b72f-932a75c7e44c\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " Sep 09 20:53:08.350343 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350223 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-service-ca\") pod \"80e09881-2f27-4336-b72f-932a75c7e44c\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " Sep 09 20:53:08.350343 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350246 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-oauth-config\") pod \"80e09881-2f27-4336-b72f-932a75c7e44c\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " Sep 09 20:53:08.350343 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350285 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-console-config\") pod \"80e09881-2f27-4336-b72f-932a75c7e44c\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " Sep 09 20:53:08.350343 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350313 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kcnk\" (UniqueName: \"kubernetes.io/projected/80e09881-2f27-4336-b72f-932a75c7e44c-kube-api-access-5kcnk\") pod \"80e09881-2f27-4336-b72f-932a75c7e44c\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " Sep 09 20:53:08.350619 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350347 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-oauth-serving-cert\") pod \"80e09881-2f27-4336-b72f-932a75c7e44c\" (UID: \"80e09881-2f27-4336-b72f-932a75c7e44c\") " Sep 09 20:53:08.350675 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350654 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-service-ca" (OuterVolumeSpecName: "service-ca") pod "80e09881-2f27-4336-b72f-932a75c7e44c" (UID: "80e09881-2f27-4336-b72f-932a75c7e44c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:53:08.350732 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350662 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "80e09881-2f27-4336-b72f-932a75c7e44c" (UID: "80e09881-2f27-4336-b72f-932a75c7e44c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:53:08.350797 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350769 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-console-config" (OuterVolumeSpecName: "console-config") pod "80e09881-2f27-4336-b72f-932a75c7e44c" (UID: "80e09881-2f27-4336-b72f-932a75c7e44c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:53:08.350883 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.350861 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "80e09881-2f27-4336-b72f-932a75c7e44c" (UID: "80e09881-2f27-4336-b72f-932a75c7e44c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:53:08.352405 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.352373 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "80e09881-2f27-4336-b72f-932a75c7e44c" (UID: "80e09881-2f27-4336-b72f-932a75c7e44c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:53:08.352405 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.352385 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "80e09881-2f27-4336-b72f-932a75c7e44c" (UID: "80e09881-2f27-4336-b72f-932a75c7e44c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:53:08.352571 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.352484 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e09881-2f27-4336-b72f-932a75c7e44c-kube-api-access-5kcnk" (OuterVolumeSpecName: "kube-api-access-5kcnk") pod "80e09881-2f27-4336-b72f-932a75c7e44c" (UID: "80e09881-2f27-4336-b72f-932a75c7e44c"). InnerVolumeSpecName "kube-api-access-5kcnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:53:08.451670 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.451643 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-console-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:08.451670 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.451667 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kcnk\" (UniqueName: \"kubernetes.io/projected/80e09881-2f27-4336-b72f-932a75c7e44c-kube-api-access-5kcnk\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:08.451806 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.451681 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-oauth-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:08.451806 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.451694 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:08.451806 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.451706 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-trusted-ca-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:08.451806 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.451718 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/80e09881-2f27-4336-b72f-932a75c7e44c-service-ca\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:08.451806 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.451730 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/80e09881-2f27-4336-b72f-932a75c7e44c-console-oauth-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:08.643712 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.643641 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" podUID="f74a7b96-3360-437a-9959-a91753ebf8ab" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 20:53:08.643712 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.643704 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" Sep 09 20:53:08.644139 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.644123 2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1b187696963ab2d83285eb33cabd8ab64e41aa6beb49399ab04765722b950acb"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 09 20:53:08.644190 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:08.644168 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" podUID="f74a7b96-3360-437a-9959-a91753ebf8ab" containerName="service-proxy" containerID="cri-o://1b187696963ab2d83285eb33cabd8ab64e41aa6beb49399ab04765722b950acb" gracePeriod=30 Sep 09 20:53:08.673877 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:53:08.673852 2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf74a7b96_3360_437a_9959_a91753ebf8ab.slice/crio-conmon-1b187696963ab2d83285eb33cabd8ab64e41aa6beb49399ab04765722b950acb.scope\": RecentStats: unable to find data in memory cache]" Sep 09 20:53:09.051563 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.051531 2580 generic.go:356] "Generic (PLEG): container finished" podID="80e09881-2f27-4336-b72f-932a75c7e44c" containerID="6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708" exitCode=0 Sep 09 20:53:09.051908 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.051577 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57666bcbfd-4gxsd" Sep 09 20:53:09.051908 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.051612 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57666bcbfd-4gxsd" event={"ID":"80e09881-2f27-4336-b72f-932a75c7e44c","Type":"ContainerDied","Data":"6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708"} Sep 09 20:53:09.051908 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.051652 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57666bcbfd-4gxsd" event={"ID":"80e09881-2f27-4336-b72f-932a75c7e44c","Type":"ContainerDied","Data":"eb98a153816a7b20c7b713d04547a6c4c4a72b205ac6a3a0c23cf0ccd0d96eaf"} Sep 09 20:53:09.051908 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.051674 2580 scope.go:117] "RemoveContainer" containerID="6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708" Sep 09 20:53:09.054351 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.054332 2580 generic.go:356] "Generic (PLEG): container finished" podID="f74a7b96-3360-437a-9959-a91753ebf8ab" containerID="1b187696963ab2d83285eb33cabd8ab64e41aa6beb49399ab04765722b950acb" exitCode=2 Sep 09 20:53:09.054450 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.054401 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" event={"ID":"f74a7b96-3360-437a-9959-a91753ebf8ab","Type":"ContainerDied","Data":"1b187696963ab2d83285eb33cabd8ab64e41aa6beb49399ab04765722b950acb"} Sep 09 20:53:09.054450 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.054436 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d4fdd897f-jcp58" event={"ID":"f74a7b96-3360-437a-9959-a91753ebf8ab","Type":"ContainerStarted","Data":"dd1e1801f6c8be5fadf3fb81e1691fcb4ceb59b27e7826ec920171de90dcefc0"} Sep 09 20:53:09.061521 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.061505 2580 scope.go:117] "RemoveContainer" containerID="6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708" Sep 09 20:53:09.062247 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:53:09.062229 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708\": container with ID starting with 6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708 not found: ID does not exist" containerID="6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708" Sep 09 20:53:09.062325 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.062254 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708"} err="failed to get container status \"6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708\": rpc error: code = NotFound desc = could not find container \"6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708\": container with ID starting with 6f6aa9ff2ca7c8484ca356ce08afb723be63bfd828ef4dad9a9a181b72cdd708 not found: ID does not exist" Sep 09 20:53:09.091535 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.091511 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57666bcbfd-4gxsd"] Sep 09 20:53:09.095934 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.095914 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57666bcbfd-4gxsd"] Sep 09 20:53:09.884908 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:09.884875 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80e09881-2f27-4336-b72f-932a75c7e44c" path="/var/lib/kubelet/pods/80e09881-2f27-4336-b72f-932a75c7e44c/volumes" Sep 09 20:53:31.834874 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:31.834836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:53:31.837208 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:31.837184 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/baaab02f-8a89-400e-a327-f5d48b6907b5-metrics-certs\") pod \"network-metrics-daemon-9k7qt\" (UID: \"baaab02f-8a89-400e-a327-f5d48b6907b5\") " pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:53:32.084307 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:32.084275 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-slrrp\"" Sep 09 20:53:32.092533 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:32.092475 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9k7qt" Sep 09 20:53:32.363142 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:32.363117 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9k7qt"] Sep 09 20:53:32.365476 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:53:32.365437 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaaab02f_8a89_400e_a327_f5d48b6907b5.slice/crio-1abc51e2c299fc90595a0b9ab7bf731bc89a88cacd722d68d8a8395ad2f74d78 WatchSource:0}: Error finding container 1abc51e2c299fc90595a0b9ab7bf731bc89a88cacd722d68d8a8395ad2f74d78: Status 404 returned error can't find the container with id 1abc51e2c299fc90595a0b9ab7bf731bc89a88cacd722d68d8a8395ad2f74d78 Sep 09 20:53:33.144562 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:33.144520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9k7qt" event={"ID":"baaab02f-8a89-400e-a327-f5d48b6907b5","Type":"ContainerStarted","Data":"1abc51e2c299fc90595a0b9ab7bf731bc89a88cacd722d68d8a8395ad2f74d78"} Sep 09 20:53:34.150398 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:34.150363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9k7qt" event={"ID":"baaab02f-8a89-400e-a327-f5d48b6907b5","Type":"ContainerStarted","Data":"255d041f449c51eb03617dbb303c9ad4d3f9f078e993b90981c9af1dbb737512"} Sep 09 20:53:34.150788 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:34.150419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9k7qt" event={"ID":"baaab02f-8a89-400e-a327-f5d48b6907b5","Type":"ContainerStarted","Data":"2f7c5e1407392b193dedd04a846d387b5baf58cb2829304bd5589a9785571562"} Sep 09 20:53:34.167281 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:34.167230 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9k7qt" podStartSLOduration=375.259044012 podStartE2EDuration="6m16.167216158s" totalImagesPullingTime="908.172146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:34.166356385 +0000 UTC m=+376.768167956" watchObservedRunningTime="2026-09-09 20:53:34.167216158 +0000 UTC m=+376.769027729" Sep 09 20:53:43.070513 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:43.070474 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:53:43.071038 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:43.070744 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="alertmanager" containerID="cri-o://6ac99afa322219b5662dfed3da37053a871a7fdb58ce067d036fdc95e6d2609c" gracePeriod=120 Sep 09 20:53:43.071038 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:43.070813 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy-metric" containerID="cri-o://04f8d13dcd927ee15998a3ed9fd96f182ed4464d713eb42c5079f73731d40f2b" gracePeriod=120 Sep 09 20:53:43.071038 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:43.070869 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy-web" containerID="cri-o://9dc202bfabf5740fd324cf67c6014996ccf14d47f8ae8b12bc0cd08827b7f736" gracePeriod=120 Sep 09 20:53:43.071038 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:43.070926 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="prom-label-proxy" containerID="cri-o://d05bff48b84a9d72158caf45888e82aa03fb37b47458b8cd730ca8552a417135" gracePeriod=120 Sep 09 20:53:43.071038 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:43.070912 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="config-reloader" containerID="cri-o://f71ae6b9a2ee25ac837115cc9ac285a4cbb2fd7ce4922bc704a2bf01b1a571de" gracePeriod=120 Sep 09 20:53:43.071038 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:43.070878 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy" containerID="cri-o://25066a4348bb3e675ac6d07f809edc9f4d1d20e46046c67dda14759cf47b7bc4" gracePeriod=120 Sep 09 20:53:44.190482 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190440 2580 generic.go:356] "Generic (PLEG): container finished" podID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerID="d05bff48b84a9d72158caf45888e82aa03fb37b47458b8cd730ca8552a417135" exitCode=0 Sep 09 20:53:44.190482 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190480 2580 generic.go:356] "Generic (PLEG): container finished" podID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerID="04f8d13dcd927ee15998a3ed9fd96f182ed4464d713eb42c5079f73731d40f2b" exitCode=0 Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190489 2580 generic.go:356] "Generic (PLEG): container finished" podID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerID="25066a4348bb3e675ac6d07f809edc9f4d1d20e46046c67dda14759cf47b7bc4" exitCode=0 Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190497 2580 generic.go:356] "Generic (PLEG): container finished" podID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerID="9dc202bfabf5740fd324cf67c6014996ccf14d47f8ae8b12bc0cd08827b7f736" exitCode=0 Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190495 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerDied","Data":"d05bff48b84a9d72158caf45888e82aa03fb37b47458b8cd730ca8552a417135"} Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190568 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerDied","Data":"04f8d13dcd927ee15998a3ed9fd96f182ed4464d713eb42c5079f73731d40f2b"} Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190504 2580 generic.go:356] "Generic (PLEG): container finished" podID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerID="f71ae6b9a2ee25ac837115cc9ac285a4cbb2fd7ce4922bc704a2bf01b1a571de" exitCode=0 Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190595 2580 generic.go:356] "Generic (PLEG): container finished" podID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerID="6ac99afa322219b5662dfed3da37053a871a7fdb58ce067d036fdc95e6d2609c" exitCode=0 Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190601 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerDied","Data":"25066a4348bb3e675ac6d07f809edc9f4d1d20e46046c67dda14759cf47b7bc4"} Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerDied","Data":"9dc202bfabf5740fd324cf67c6014996ccf14d47f8ae8b12bc0cd08827b7f736"} Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190655 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerDied","Data":"f71ae6b9a2ee25ac837115cc9ac285a4cbb2fd7ce4922bc704a2bf01b1a571de"} Sep 09 20:53:44.190808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.190678 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerDied","Data":"6ac99afa322219b5662dfed3da37053a871a7fdb58ce067d036fdc95e6d2609c"} Sep 09 20:53:44.310709 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.310688 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:44.417969 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.417897 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.417969 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.417927 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-web-config\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.417969 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.417950 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv5qq\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-kube-api-access-bv5qq\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418197 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.417983 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-cluster-tls-config\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418197 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418009 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-web\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418197 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418034 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418197 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418062 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-metrics-client-ca\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418197 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418084 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-tls-assets\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418197 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418128 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-trusted-ca-bundle\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418197 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418168 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-main-tls\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418561 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418205 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-main-db\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418561 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418231 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-volume\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.418561 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418267 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-out\") pod \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\" (UID: \"6925be7f-c0f5-4123-85ea-42dcbf5073d9\") " Sep 09 20:53:44.419173 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418775 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:53:44.419173 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.418798 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:53:44.419173 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.419152 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:53:44.421104 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.421065 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:53:44.421297 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.421272 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-out" (OuterVolumeSpecName: "config-out") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:53:44.421411 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.421358 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:53:44.421545 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.421456 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-kube-api-access-bv5qq" (OuterVolumeSpecName: "kube-api-access-bv5qq") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "kube-api-access-bv5qq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:53:44.421615 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.421587 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:53:44.421941 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.421913 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:53:44.422379 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.422357 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:53:44.422514 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.422487 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-volume" (OuterVolumeSpecName: "config-volume") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:53:44.424846 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.424770 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:53:44.430104 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.430081 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-web-config" (OuterVolumeSpecName: "web-config") pod "6925be7f-c0f5-4123-85ea-42dcbf5073d9" (UID: "6925be7f-c0f5-4123-85ea-42dcbf5073d9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:53:44.519582 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519551 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519582 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519581 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-web-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519591 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv5qq\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-kube-api-access-bv5qq\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519600 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-cluster-tls-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519608 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519617 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519626 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-metrics-client-ca\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519634 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6925be7f-c0f5-4123-85ea-42dcbf5073d9-tls-assets\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519641 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519651 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-secret-alertmanager-main-tls\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519659 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-alertmanager-main-db\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519667 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-volume\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:44.519685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:44.519676 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6925be7f-c0f5-4123-85ea-42dcbf5073d9-config-out\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:53:45.197257 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.197216 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6925be7f-c0f5-4123-85ea-42dcbf5073d9","Type":"ContainerDied","Data":"0906e3dd193526a873768a2b0bd77fbe43363d1557ef5cf9d38924d445cb0c6e"} Sep 09 20:53:45.197257 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.197240 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.197734 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.197310 2580 scope.go:117] "RemoveContainer" containerID="d05bff48b84a9d72158caf45888e82aa03fb37b47458b8cd730ca8552a417135" Sep 09 20:53:45.204742 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.204725 2580 scope.go:117] "RemoveContainer" containerID="04f8d13dcd927ee15998a3ed9fd96f182ed4464d713eb42c5079f73731d40f2b" Sep 09 20:53:45.211640 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.211600 2580 scope.go:117] "RemoveContainer" containerID="25066a4348bb3e675ac6d07f809edc9f4d1d20e46046c67dda14759cf47b7bc4" Sep 09 20:53:45.218137 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.218120 2580 scope.go:117] "RemoveContainer" containerID="9dc202bfabf5740fd324cf67c6014996ccf14d47f8ae8b12bc0cd08827b7f736" Sep 09 20:53:45.225051 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.225030 2580 scope.go:117] "RemoveContainer" containerID="f71ae6b9a2ee25ac837115cc9ac285a4cbb2fd7ce4922bc704a2bf01b1a571de" Sep 09 20:53:45.231907 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.228539 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:53:45.234273 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.234243 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:53:45.238556 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.238524 2580 scope.go:117] "RemoveContainer" containerID="6ac99afa322219b5662dfed3da37053a871a7fdb58ce067d036fdc95e6d2609c" Sep 09 20:53:45.245494 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.245471 2580 scope.go:117] "RemoveContainer" containerID="dd9069312891c25513d0025b0ea16ce360cef064dc974e70b02c48cde952adc5" Sep 09 20:53:45.264782 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.264758 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:53:45.265020 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265008 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy" Sep 09 20:53:45.265062 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265022 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy" Sep 09 20:53:45.265062 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265034 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" containerName="console" Sep 09 20:53:45.265062 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265040 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" containerName="console" Sep 09 20:53:45.265062 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265047 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy-web" Sep 09 20:53:45.265062 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265052 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy-web" Sep 09 20:53:45.265062 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265060 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e09881-2f27-4336-b72f-932a75c7e44c" containerName="console" Sep 09 20:53:45.265062 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265065 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e09881-2f27-4336-b72f-932a75c7e44c" containerName="console" Sep 09 20:53:45.265062 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265071 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="init-config-reloader" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265076 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="init-config-reloader" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265084 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f56d55c-71ab-4834-86fe-848836e965c9" containerName="console" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265089 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f56d55c-71ab-4834-86fe-848836e965c9" containerName="console" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265096 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="prom-label-proxy" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265101 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="prom-label-proxy" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265107 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="config-reloader" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265112 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="config-reloader" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265117 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="alertmanager" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265123 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="alertmanager" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265131 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy-metric" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265136 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy-metric" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265172 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f56d55c-71ab-4834-86fe-848836e965c9" containerName="console" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265180 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e09881-2f27-4336-b72f-932a75c7e44c" containerName="console" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265185 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="alertmanager" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265191 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy-web" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265196 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="prom-label-proxy" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265202 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="config-reloader" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265208 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265213 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" containerName="kube-rbac-proxy-metric" Sep 09 20:53:45.265294 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.265219 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc38e05-d2c6-4e4e-a13c-43e5fe8b1a56" containerName="console" Sep 09 20:53:45.268651 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.268635 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.271286 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.271263 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 20:53:45.271377 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.271272 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 20:53:45.271754 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.271737 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 20:53:45.271838 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.271740 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 20:53:45.272115 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.272099 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 20:53:45.272193 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.272126 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 20:53:45.272485 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.272452 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 20:53:45.272640 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.272627 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 20:53:45.272713 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.272653 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j8srp\"" Sep 09 20:53:45.277868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.277847 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 20:53:45.291028 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.291001 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:53:45.426747 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426656 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-config-volume\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.426747 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426688 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.426747 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-web-config\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426819 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tffph\" (UniqueName: \"kubernetes.io/projected/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-kube-api-access-tffph\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-config-out\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.426990 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.427031 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.427068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.427059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528032 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.527990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528218 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528218 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-config-volume\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528218 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528218 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528218 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528218 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-web-config\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tffph\" (UniqueName: \"kubernetes.io/projected/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-kube-api-access-tffph\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-config-out\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528298 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.528554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.528512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.529180 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.529107 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.529724 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.529696 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.531281 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.531254 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.531437 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.531385 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.531631 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.531603 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-config-out\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.531732 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.531711 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-config-volume\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.531959 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.531940 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.532037 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.531961 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.532125 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.532104 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.532178 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.532116 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.533350 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.533335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-web-config\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.537882 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.537861 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tffph\" (UniqueName: \"kubernetes.io/projected/b87c1ac0-a09a-482b-ba98-83af8d17cdbf-kube-api-access-tffph\") pod \"alertmanager-main-0\" (UID: \"b87c1ac0-a09a-482b-ba98-83af8d17cdbf\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.578496 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.578428 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 20:53:45.863091 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.863061 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 20:53:45.863776 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:53:45.863752 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87c1ac0_a09a_482b_ba98_83af8d17cdbf.slice/crio-7b35ef7b825c93b9aa17603890faa27637e869ff0e882fe7f6e16ce247a7f887 WatchSource:0}: Error finding container 7b35ef7b825c93b9aa17603890faa27637e869ff0e882fe7f6e16ce247a7f887: Status 404 returned error can't find the container with id 7b35ef7b825c93b9aa17603890faa27637e869ff0e882fe7f6e16ce247a7f887 Sep 09 20:53:45.884429 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:45.884395 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6925be7f-c0f5-4123-85ea-42dcbf5073d9" path="/var/lib/kubelet/pods/6925be7f-c0f5-4123-85ea-42dcbf5073d9/volumes" Sep 09 20:53:46.202499 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:46.202392 2580 generic.go:356] "Generic (PLEG): container finished" podID="b87c1ac0-a09a-482b-ba98-83af8d17cdbf" containerID="c948ce43a3a4cd3cc15e53a4ed7c5085bc0573c26f3d0b9c510ee79009081ef4" exitCode=0 Sep 09 20:53:46.202943 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:46.202498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b87c1ac0-a09a-482b-ba98-83af8d17cdbf","Type":"ContainerDied","Data":"c948ce43a3a4cd3cc15e53a4ed7c5085bc0573c26f3d0b9c510ee79009081ef4"} Sep 09 20:53:46.202943 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:46.202585 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b87c1ac0-a09a-482b-ba98-83af8d17cdbf","Type":"ContainerStarted","Data":"7b35ef7b825c93b9aa17603890faa27637e869ff0e882fe7f6e16ce247a7f887"} Sep 09 20:53:47.214432 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:47.214391 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b87c1ac0-a09a-482b-ba98-83af8d17cdbf","Type":"ContainerStarted","Data":"7e03cd7997833cdeb5f4e5bb3475324dc0b73f65c4e832b7474164c7cad59215"} Sep 09 20:53:47.214868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:47.214523 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b87c1ac0-a09a-482b-ba98-83af8d17cdbf","Type":"ContainerStarted","Data":"8942aec5bd5ce7f0325c1482dc8b9de1af05375a23bae7999ddcfaa99b6e0427"} Sep 09 20:53:47.214868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:47.214569 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b87c1ac0-a09a-482b-ba98-83af8d17cdbf","Type":"ContainerStarted","Data":"b9cbd0beb84341cc0b965f0e7a281215c160681d5e96591799a2d366162811f7"} Sep 09 20:53:47.214868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:47.214606 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b87c1ac0-a09a-482b-ba98-83af8d17cdbf","Type":"ContainerStarted","Data":"14b09f838b5070d860012280b0a2c2c6c1c09a0c074643af99a7a595694b6e1b"} Sep 09 20:53:47.214868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:47.214643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b87c1ac0-a09a-482b-ba98-83af8d17cdbf","Type":"ContainerStarted","Data":"77fbc200552c6ee70e9fdbae68c2ed081f23aa31015f3841c98ca1092ede576a"} Sep 09 20:53:47.214868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:47.214678 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b87c1ac0-a09a-482b-ba98-83af8d17cdbf","Type":"ContainerStarted","Data":"f70ea13a9aeec7e144d3d07162b842fd908e6195e95089837fff15cea746092b"} Sep 09 20:53:47.265321 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:47.265267 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.245506559 podStartE2EDuration="2.265252483s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.745924ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:47.261352255 +0000 UTC m=+389.863163826" watchObservedRunningTime="2026-09-09 20:53:47.265252483 +0000 UTC m=+389.867064054" Sep 09 20:53:54.311979 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.311947 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58858945b4-n84b4"] Sep 09 20:53:54.313994 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.313976 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.393554 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.393523 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58858945b4-n84b4"] Sep 09 20:53:54.396566 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.396541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-console-config\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.396700 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.396586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-serving-cert\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.396700 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.396605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-service-ca\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.396700 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.396672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s49kq\" (UniqueName: \"kubernetes.io/projected/b3f31644-4416-461a-918c-f1132bffd9d3-kube-api-access-s49kq\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.396823 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.396730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-oauth-config\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.396823 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.396757 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-trusted-ca-bundle\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.396823 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.396803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-oauth-serving-cert\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.497823 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.497790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-service-ca\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.497925 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.497831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s49kq\" (UniqueName: \"kubernetes.io/projected/b3f31644-4416-461a-918c-f1132bffd9d3-kube-api-access-s49kq\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.497925 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.497856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-oauth-config\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.497925 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.497878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-trusted-ca-bundle\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.498033 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.497989 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-oauth-serving-cert\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.498073 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.498042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-console-config\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.498147 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.498118 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-serving-cert\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.498715 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.498684 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-service-ca\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.498715 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.498697 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-oauth-serving-cert\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.498859 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.498765 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-trusted-ca-bundle\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.498859 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.498788 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-console-config\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.500197 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.500161 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-oauth-config\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.500364 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.500347 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-serving-cert\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.506220 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.506199 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s49kq\" (UniqueName: \"kubernetes.io/projected/b3f31644-4416-461a-918c-f1132bffd9d3-kube-api-access-s49kq\") pod \"console-58858945b4-n84b4\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.623249 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.623177 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:53:54.898565 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:54.898450 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58858945b4-n84b4"] Sep 09 20:53:54.901076 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:53:54.901049 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f31644_4416_461a_918c_f1132bffd9d3.slice/crio-6cb7dd4b99a19f87343b1e3f15027da93168f540dce061189d829e6989315887 WatchSource:0}: Error finding container 6cb7dd4b99a19f87343b1e3f15027da93168f540dce061189d829e6989315887: Status 404 returned error can't find the container with id 6cb7dd4b99a19f87343b1e3f15027da93168f540dce061189d829e6989315887 Sep 09 20:53:55.246260 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:55.246173 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58858945b4-n84b4" event={"ID":"b3f31644-4416-461a-918c-f1132bffd9d3","Type":"ContainerStarted","Data":"efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c"} Sep 09 20:53:55.246260 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:55.246229 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58858945b4-n84b4" event={"ID":"b3f31644-4416-461a-918c-f1132bffd9d3","Type":"ContainerStarted","Data":"6cb7dd4b99a19f87343b1e3f15027da93168f540dce061189d829e6989315887"} Sep 09 20:53:55.264625 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:53:55.264580 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58858945b4-n84b4" podStartSLOduration=1.26456398 podStartE2EDuration="1.26456398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:53:55.263703794 +0000 UTC m=+397.865515364" watchObservedRunningTime="2026-09-09 20:53:55.26456398 +0000 UTC m=+397.866375552" Sep 09 20:54:04.623369 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:04.623334 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:54:04.623770 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:04.623394 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:54:04.628204 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:04.628184 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:54:05.285215 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:05.285189 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:54:05.331276 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:05.331250 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699587656-zq4pt"] Sep 09 20:54:30.351621 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.351563 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-699587656-zq4pt" podUID="83620516-a6b9-4015-911b-4afbdc1ed9ec" containerName="console" containerID="cri-o://bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e" gracePeriod=15 Sep 09 20:54:30.583851 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.583826 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699587656-zq4pt" Sep 09 20:54:30.637096 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637037 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-trusted-ca-bundle\") pod \"83620516-a6b9-4015-911b-4afbdc1ed9ec\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " Sep 09 20:54:30.637096 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637073 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-oauth-config\") pod \"83620516-a6b9-4015-911b-4afbdc1ed9ec\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " Sep 09 20:54:30.637096 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637096 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-oauth-serving-cert\") pod \"83620516-a6b9-4015-911b-4afbdc1ed9ec\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " Sep 09 20:54:30.637316 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637131 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-config\") pod \"83620516-a6b9-4015-911b-4afbdc1ed9ec\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " Sep 09 20:54:30.637316 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637158 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-serving-cert\") pod \"83620516-a6b9-4015-911b-4afbdc1ed9ec\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " Sep 09 20:54:30.637316 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637201 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp5hz\" (UniqueName: \"kubernetes.io/projected/83620516-a6b9-4015-911b-4afbdc1ed9ec-kube-api-access-gp5hz\") pod \"83620516-a6b9-4015-911b-4afbdc1ed9ec\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " Sep 09 20:54:30.637316 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637231 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-service-ca\") pod \"83620516-a6b9-4015-911b-4afbdc1ed9ec\" (UID: \"83620516-a6b9-4015-911b-4afbdc1ed9ec\") " Sep 09 20:54:30.637566 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637536 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "83620516-a6b9-4015-911b-4afbdc1ed9ec" (UID: "83620516-a6b9-4015-911b-4afbdc1ed9ec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:54:30.637566 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637548 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "83620516-a6b9-4015-911b-4afbdc1ed9ec" (UID: "83620516-a6b9-4015-911b-4afbdc1ed9ec"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:54:30.637725 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637705 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-config" (OuterVolumeSpecName: "console-config") pod "83620516-a6b9-4015-911b-4afbdc1ed9ec" (UID: "83620516-a6b9-4015-911b-4afbdc1ed9ec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:54:30.637837 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.637771 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-service-ca" (OuterVolumeSpecName: "service-ca") pod "83620516-a6b9-4015-911b-4afbdc1ed9ec" (UID: "83620516-a6b9-4015-911b-4afbdc1ed9ec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:54:30.639235 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.639212 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "83620516-a6b9-4015-911b-4afbdc1ed9ec" (UID: "83620516-a6b9-4015-911b-4afbdc1ed9ec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:54:30.639325 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.639234 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "83620516-a6b9-4015-911b-4afbdc1ed9ec" (UID: "83620516-a6b9-4015-911b-4afbdc1ed9ec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:54:30.639325 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.639256 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83620516-a6b9-4015-911b-4afbdc1ed9ec-kube-api-access-gp5hz" (OuterVolumeSpecName: "kube-api-access-gp5hz") pod "83620516-a6b9-4015-911b-4afbdc1ed9ec" (UID: "83620516-a6b9-4015-911b-4afbdc1ed9ec"). InnerVolumeSpecName "kube-api-access-gp5hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:54:30.738297 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.738270 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-oauth-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:54:30.738297 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.738292 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:54:30.738297 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.738302 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:54:30.738492 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.738311 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp5hz\" (UniqueName: \"kubernetes.io/projected/83620516-a6b9-4015-911b-4afbdc1ed9ec-kube-api-access-gp5hz\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:54:30.738492 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.738319 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-service-ca\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:54:30.738492 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.738327 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83620516-a6b9-4015-911b-4afbdc1ed9ec-trusted-ca-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:54:30.738492 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:30.738335 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83620516-a6b9-4015-911b-4afbdc1ed9ec-console-oauth-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:54:31.377181 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.377149 2580 generic.go:356] "Generic (PLEG): container finished" podID="83620516-a6b9-4015-911b-4afbdc1ed9ec" containerID="bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e" exitCode=0 Sep 09 20:54:31.377576 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.377195 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699587656-zq4pt" Sep 09 20:54:31.377576 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.377203 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699587656-zq4pt" event={"ID":"83620516-a6b9-4015-911b-4afbdc1ed9ec","Type":"ContainerDied","Data":"bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e"} Sep 09 20:54:31.377576 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.377243 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699587656-zq4pt" event={"ID":"83620516-a6b9-4015-911b-4afbdc1ed9ec","Type":"ContainerDied","Data":"4b33facc16cb574d4ca3a8d9f2b2a2fd3b86fb0b7c2da0741ed7aa288f69f4e2"} Sep 09 20:54:31.377576 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.377275 2580 scope.go:117] "RemoveContainer" containerID="bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e" Sep 09 20:54:31.385862 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.385844 2580 scope.go:117] "RemoveContainer" containerID="bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e" Sep 09 20:54:31.386133 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:54:31.386112 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e\": container with ID starting with bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e not found: ID does not exist" containerID="bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e" Sep 09 20:54:31.386209 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.386143 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e"} err="failed to get container status \"bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e\": rpc error: code = NotFound desc = could not find container \"bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e\": container with ID starting with bffe8584794de418d03ae0d7af4e2d7258c0103a4e8f22378ebd9cff292b742e not found: ID does not exist" Sep 09 20:54:31.398431 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.398406 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699587656-zq4pt"] Sep 09 20:54:31.400971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.400951 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-699587656-zq4pt"] Sep 09 20:54:31.884622 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:54:31.884593 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83620516-a6b9-4015-911b-4afbdc1ed9ec" path="/var/lib/kubelet/pods/83620516-a6b9-4015-911b-4afbdc1ed9ec/volumes" Sep 09 20:55:01.803221 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.803186 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k"] Sep 09 20:55:01.803838 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.803587 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83620516-a6b9-4015-911b-4afbdc1ed9ec" containerName="console" Sep 09 20:55:01.803838 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.803607 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83620516-a6b9-4015-911b-4afbdc1ed9ec" containerName="console" Sep 09 20:55:01.803838 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.803694 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83620516-a6b9-4015-911b-4afbdc1ed9ec" containerName="console" Sep 09 20:55:01.807004 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.806982 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:01.809559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.809535 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 20:55:01.809680 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.809585 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bx95v\"" Sep 09 20:55:01.810215 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.810199 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 20:55:01.817255 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.817234 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k"] Sep 09 20:55:01.854073 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.854048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:01.854171 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.854080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:01.854171 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.854118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flbzq\" (UniqueName: \"kubernetes.io/projected/dab36360-081e-4aba-9aa2-f4689e2188be-kube-api-access-flbzq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:01.954682 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.954652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:01.954682 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.954684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:01.954894 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.954729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flbzq\" (UniqueName: \"kubernetes.io/projected/dab36360-081e-4aba-9aa2-f4689e2188be-kube-api-access-flbzq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:01.955100 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.955077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:01.955161 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.955136 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:01.963140 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:01.963114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flbzq\" (UniqueName: \"kubernetes.io/projected/dab36360-081e-4aba-9aa2-f4689e2188be-kube-api-access-flbzq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:02.116099 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:02.116033 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:02.384097 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:02.384022 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k"] Sep 09 20:55:02.387520 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:55:02.387486 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab36360_081e_4aba_9aa2_f4689e2188be.slice/crio-3b6108ee1afa78c0e3d5eb7c4552edfb8993b1bd6ffb0590ee677eb3971822b7 WatchSource:0}: Error finding container 3b6108ee1afa78c0e3d5eb7c4552edfb8993b1bd6ffb0590ee677eb3971822b7: Status 404 returned error can't find the container with id 3b6108ee1afa78c0e3d5eb7c4552edfb8993b1bd6ffb0590ee677eb3971822b7 Sep 09 20:55:02.497913 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:02.497887 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" event={"ID":"dab36360-081e-4aba-9aa2-f4689e2188be","Type":"ContainerStarted","Data":"3b6108ee1afa78c0e3d5eb7c4552edfb8993b1bd6ffb0590ee677eb3971822b7"} Sep 09 20:55:09.528970 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:09.528933 2580 generic.go:356] "Generic (PLEG): container finished" podID="dab36360-081e-4aba-9aa2-f4689e2188be" containerID="ba8f1ec11c4f3cb41e0c297e81d4a99807be6f9a6d30bb5f1804b125d8dde198" exitCode=0 Sep 09 20:55:09.529381 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:09.529024 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" event={"ID":"dab36360-081e-4aba-9aa2-f4689e2188be","Type":"ContainerDied","Data":"ba8f1ec11c4f3cb41e0c297e81d4a99807be6f9a6d30bb5f1804b125d8dde198"} Sep 09 20:55:12.543552 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:12.543515 2580 generic.go:356] "Generic (PLEG): container finished" podID="dab36360-081e-4aba-9aa2-f4689e2188be" containerID="06c5a1c200d88cfcfb9faeae5f5a4b0940dcd3de1ea6f606dec140bc1e602dc6" exitCode=0 Sep 09 20:55:12.543936 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:12.543570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" event={"ID":"dab36360-081e-4aba-9aa2-f4689e2188be","Type":"ContainerDied","Data":"06c5a1c200d88cfcfb9faeae5f5a4b0940dcd3de1ea6f606dec140bc1e602dc6"} Sep 09 20:55:21.580900 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:21.580864 2580 generic.go:356] "Generic (PLEG): container finished" podID="dab36360-081e-4aba-9aa2-f4689e2188be" containerID="660059949aff68c1336cb8db2c3e148b4ec6bc090a635e818864a012e82b22e2" exitCode=0 Sep 09 20:55:21.581340 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:21.580951 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" event={"ID":"dab36360-081e-4aba-9aa2-f4689e2188be","Type":"ContainerDied","Data":"660059949aff68c1336cb8db2c3e148b4ec6bc090a635e818864a012e82b22e2"} Sep 09 20:55:22.739252 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.739227 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:22.824360 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.824334 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-bundle\") pod \"dab36360-081e-4aba-9aa2-f4689e2188be\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " Sep 09 20:55:22.824514 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.824384 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flbzq\" (UniqueName: \"kubernetes.io/projected/dab36360-081e-4aba-9aa2-f4689e2188be-kube-api-access-flbzq\") pod \"dab36360-081e-4aba-9aa2-f4689e2188be\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " Sep 09 20:55:22.824514 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.824415 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-util\") pod \"dab36360-081e-4aba-9aa2-f4689e2188be\" (UID: \"dab36360-081e-4aba-9aa2-f4689e2188be\") " Sep 09 20:55:22.825025 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.825000 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-bundle" (OuterVolumeSpecName: "bundle") pod "dab36360-081e-4aba-9aa2-f4689e2188be" (UID: "dab36360-081e-4aba-9aa2-f4689e2188be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:55:22.826513 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.826491 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab36360-081e-4aba-9aa2-f4689e2188be-kube-api-access-flbzq" (OuterVolumeSpecName: "kube-api-access-flbzq") pod "dab36360-081e-4aba-9aa2-f4689e2188be" (UID: "dab36360-081e-4aba-9aa2-f4689e2188be"). InnerVolumeSpecName "kube-api-access-flbzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:55:22.829270 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.829248 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-util" (OuterVolumeSpecName: "util") pod "dab36360-081e-4aba-9aa2-f4689e2188be" (UID: "dab36360-081e-4aba-9aa2-f4689e2188be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:55:22.925828 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.925780 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:55:22.925828 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.925799 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flbzq\" (UniqueName: \"kubernetes.io/projected/dab36360-081e-4aba-9aa2-f4689e2188be-kube-api-access-flbzq\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:55:22.925828 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:22.925809 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dab36360-081e-4aba-9aa2-f4689e2188be-util\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:55:23.589826 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:23.589797 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" Sep 09 20:55:23.589980 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:23.589795 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h794k" event={"ID":"dab36360-081e-4aba-9aa2-f4689e2188be","Type":"ContainerDied","Data":"3b6108ee1afa78c0e3d5eb7c4552edfb8993b1bd6ffb0590ee677eb3971822b7"} Sep 09 20:55:23.589980 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:23.589937 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b6108ee1afa78c0e3d5eb7c4552edfb8993b1bd6ffb0590ee677eb3971822b7" Sep 09 20:55:29.932733 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.932698 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9"] Sep 09 20:55:29.933271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.933046 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab36360-081e-4aba-9aa2-f4689e2188be" containerName="util" Sep 09 20:55:29.933271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.933064 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab36360-081e-4aba-9aa2-f4689e2188be" containerName="util" Sep 09 20:55:29.933271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.933080 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab36360-081e-4aba-9aa2-f4689e2188be" containerName="pull" Sep 09 20:55:29.933271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.933087 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab36360-081e-4aba-9aa2-f4689e2188be" containerName="pull" Sep 09 20:55:29.933271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.933115 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dab36360-081e-4aba-9aa2-f4689e2188be" containerName="extract" Sep 09 20:55:29.933271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.933122 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dab36360-081e-4aba-9aa2-f4689e2188be" containerName="extract" Sep 09 20:55:29.933271 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.933187 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dab36360-081e-4aba-9aa2-f4689e2188be" containerName="extract" Sep 09 20:55:29.935283 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.935262 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" Sep 09 20:55:29.938317 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.938294 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:55:29.938412 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.938344 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jhkq2\"" Sep 09 20:55:29.938507 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.938413 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 09 20:55:29.952837 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:29.952811 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9"] Sep 09 20:55:30.076907 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:30.076872 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86m8n\" (UniqueName: \"kubernetes.io/projected/1d43a09d-96a6-473f-bf82-6a651260d97b-kube-api-access-86m8n\") pod \"cert-manager-operator-controller-manager-55c444bf86-44ls9\" (UID: \"1d43a09d-96a6-473f-bf82-6a651260d97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" Sep 09 20:55:30.076907 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:30.076909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d43a09d-96a6-473f-bf82-6a651260d97b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-44ls9\" (UID: \"1d43a09d-96a6-473f-bf82-6a651260d97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" Sep 09 20:55:30.177629 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:30.177588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86m8n\" (UniqueName: \"kubernetes.io/projected/1d43a09d-96a6-473f-bf82-6a651260d97b-kube-api-access-86m8n\") pod \"cert-manager-operator-controller-manager-55c444bf86-44ls9\" (UID: \"1d43a09d-96a6-473f-bf82-6a651260d97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" Sep 09 20:55:30.177629 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:30.177633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d43a09d-96a6-473f-bf82-6a651260d97b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-44ls9\" (UID: \"1d43a09d-96a6-473f-bf82-6a651260d97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" Sep 09 20:55:30.177942 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:30.177925 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d43a09d-96a6-473f-bf82-6a651260d97b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-44ls9\" (UID: \"1d43a09d-96a6-473f-bf82-6a651260d97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" Sep 09 20:55:30.191758 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:30.191710 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86m8n\" (UniqueName: \"kubernetes.io/projected/1d43a09d-96a6-473f-bf82-6a651260d97b-kube-api-access-86m8n\") pod \"cert-manager-operator-controller-manager-55c444bf86-44ls9\" (UID: \"1d43a09d-96a6-473f-bf82-6a651260d97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" Sep 09 20:55:30.244580 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:30.244556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" Sep 09 20:55:30.524094 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:30.524069 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9"] Sep 09 20:55:30.525964 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:55:30.525933 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d43a09d_96a6_473f_bf82_6a651260d97b.slice/crio-05c9402afd8441aa0df236273038f9be1868e736e5200646f20d27ab8ef13696 WatchSource:0}: Error finding container 05c9402afd8441aa0df236273038f9be1868e736e5200646f20d27ab8ef13696: Status 404 returned error can't find the container with id 05c9402afd8441aa0df236273038f9be1868e736e5200646f20d27ab8ef13696 Sep 09 20:55:30.616176 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:30.616143 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" event={"ID":"1d43a09d-96a6-473f-bf82-6a651260d97b","Type":"ContainerStarted","Data":"05c9402afd8441aa0df236273038f9be1868e736e5200646f20d27ab8ef13696"} Sep 09 20:55:32.626959 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:32.626924 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" event={"ID":"1d43a09d-96a6-473f-bf82-6a651260d97b","Type":"ContainerStarted","Data":"34c9da310f978b5a221695dd5c94ad789b0f96b0a2c1c2e19d48877b73bbe453"} Sep 09 20:55:32.653771 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:32.653729 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-44ls9" podStartSLOduration=1.704662919 podStartE2EDuration="3.653713404s" totalImagesPullingTime="1.949050485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:55:32.646952784 +0000 UTC m=+495.248764353" watchObservedRunningTime="2026-09-09 20:55:32.653713404 +0000 UTC m=+495.255525046" Sep 09 20:55:33.652722 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.652691 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq"] Sep 09 20:55:33.654812 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.654797 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.657709 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.657678 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 20:55:33.657834 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.657788 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bx95v\"" Sep 09 20:55:33.658722 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.658704 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 20:55:33.674272 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.670267 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq"] Sep 09 20:55:33.806666 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.806638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.806804 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.806671 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c546l\" (UniqueName: \"kubernetes.io/projected/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-kube-api-access-c546l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.806804 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.806722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.907645 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.907581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.907645 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.907612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c546l\" (UniqueName: \"kubernetes.io/projected/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-kube-api-access-c546l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.907645 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.907634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.907923 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.907907 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.908025 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.908003 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.915974 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.915954 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c546l\" (UniqueName: \"kubernetes.io/projected/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-kube-api-access-c546l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:33.963870 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:33.963849 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:34.239813 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:34.239653 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq"] Sep 09 20:55:34.242258 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:55:34.242231 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0c9434_06fa_43b2_8ccb_321d7cb7180b.slice/crio-a4914f25dc3624fe8873d2e6204578c10518df27f2f94b08549b9f6b885e6ead WatchSource:0}: Error finding container a4914f25dc3624fe8873d2e6204578c10518df27f2f94b08549b9f6b885e6ead: Status 404 returned error can't find the container with id a4914f25dc3624fe8873d2e6204578c10518df27f2f94b08549b9f6b885e6ead Sep 09 20:55:34.635266 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:34.635236 2580 generic.go:356] "Generic (PLEG): container finished" podID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerID="b56dc3667b18530b67b9cd71d0b3dbffaa819922de1846990bf630242a9a7553" exitCode=0 Sep 09 20:55:34.635424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:34.635268 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" event={"ID":"4b0c9434-06fa-43b2-8ccb-321d7cb7180b","Type":"ContainerDied","Data":"b56dc3667b18530b67b9cd71d0b3dbffaa819922de1846990bf630242a9a7553"} Sep 09 20:55:34.635424 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:34.635318 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" event={"ID":"4b0c9434-06fa-43b2-8ccb-321d7cb7180b","Type":"ContainerStarted","Data":"a4914f25dc3624fe8873d2e6204578c10518df27f2f94b08549b9f6b885e6ead"} Sep 09 20:55:37.650257 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:37.650223 2580 generic.go:356] "Generic (PLEG): container finished" podID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerID="65e0bd94f02b56d87fb628c19b751ba455ab7f7633c89aec71774c69f8fe99ff" exitCode=0 Sep 09 20:55:37.650653 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:37.650306 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" event={"ID":"4b0c9434-06fa-43b2-8ccb-321d7cb7180b","Type":"ContainerDied","Data":"65e0bd94f02b56d87fb628c19b751ba455ab7f7633c89aec71774c69f8fe99ff"} Sep 09 20:55:38.656234 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:38.656196 2580 generic.go:356] "Generic (PLEG): container finished" podID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerID="42061b651c244c2faf6eb2f9c9c3219c63b6399f5c462f2dfb7ab3906caeb5a4" exitCode=0 Sep 09 20:55:38.656665 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:38.656286 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" event={"ID":"4b0c9434-06fa-43b2-8ccb-321d7cb7180b","Type":"ContainerDied","Data":"42061b651c244c2faf6eb2f9c9c3219c63b6399f5c462f2dfb7ab3906caeb5a4"} Sep 09 20:55:39.792449 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:39.792426 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:39.957095 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:39.957013 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-util\") pod \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " Sep 09 20:55:39.957095 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:39.957055 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c546l\" (UniqueName: \"kubernetes.io/projected/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-kube-api-access-c546l\") pod \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " Sep 09 20:55:39.957315 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:39.957107 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-bundle\") pod \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\" (UID: \"4b0c9434-06fa-43b2-8ccb-321d7cb7180b\") " Sep 09 20:55:39.957536 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:39.957501 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-bundle" (OuterVolumeSpecName: "bundle") pod "4b0c9434-06fa-43b2-8ccb-321d7cb7180b" (UID: "4b0c9434-06fa-43b2-8ccb-321d7cb7180b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:55:39.959170 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:39.959145 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-kube-api-access-c546l" (OuterVolumeSpecName: "kube-api-access-c546l") pod "4b0c9434-06fa-43b2-8ccb-321d7cb7180b" (UID: "4b0c9434-06fa-43b2-8ccb-321d7cb7180b"). InnerVolumeSpecName "kube-api-access-c546l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:55:39.961602 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:39.961579 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-util" (OuterVolumeSpecName: "util") pod "4b0c9434-06fa-43b2-8ccb-321d7cb7180b" (UID: "4b0c9434-06fa-43b2-8ccb-321d7cb7180b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:55:40.057669 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:40.057619 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-util\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:55:40.057669 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:40.057665 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c546l\" (UniqueName: \"kubernetes.io/projected/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-kube-api-access-c546l\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:55:40.057669 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:40.057680 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b0c9434-06fa-43b2-8ccb-321d7cb7180b-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:55:40.666700 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:40.666667 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" event={"ID":"4b0c9434-06fa-43b2-8ccb-321d7cb7180b","Type":"ContainerDied","Data":"a4914f25dc3624fe8873d2e6204578c10518df27f2f94b08549b9f6b885e6ead"} Sep 09 20:55:40.666700 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:40.666700 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp7wsq" Sep 09 20:55:40.666915 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:40.666723 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4914f25dc3624fe8873d2e6204578c10518df27f2f94b08549b9f6b885e6ead" Sep 09 20:55:44.471638 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.471602 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rwphh"] Sep 09 20:55:44.472027 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.471891 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerName="util" Sep 09 20:55:44.472027 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.471902 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerName="util" Sep 09 20:55:44.472027 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.471918 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerName="extract" Sep 09 20:55:44.472027 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.471923 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerName="extract" Sep 09 20:55:44.472027 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.471931 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerName="pull" Sep 09 20:55:44.472027 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.471936 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerName="pull" Sep 09 20:55:44.472027 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.471979 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b0c9434-06fa-43b2-8ccb-321d7cb7180b" containerName="extract" Sep 09 20:55:44.473668 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.473651 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rwphh" Sep 09 20:55:44.475854 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.475829 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 20:55:44.476089 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.476067 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 20:55:44.476762 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.476746 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zbsv7\"" Sep 09 20:55:44.482090 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.482068 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rwphh"] Sep 09 20:55:44.593380 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.593341 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e40d989-03b1-4bbd-bf07-5bacfcf48503-bound-sa-token\") pod \"cert-manager-55b4d954d5-rwphh\" (UID: \"7e40d989-03b1-4bbd-bf07-5bacfcf48503\") " pod="cert-manager/cert-manager-55b4d954d5-rwphh" Sep 09 20:55:44.593380 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.593382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc8l8\" (UniqueName: \"kubernetes.io/projected/7e40d989-03b1-4bbd-bf07-5bacfcf48503-kube-api-access-kc8l8\") pod \"cert-manager-55b4d954d5-rwphh\" (UID: \"7e40d989-03b1-4bbd-bf07-5bacfcf48503\") " pod="cert-manager/cert-manager-55b4d954d5-rwphh" Sep 09 20:55:44.694517 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.694483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e40d989-03b1-4bbd-bf07-5bacfcf48503-bound-sa-token\") pod \"cert-manager-55b4d954d5-rwphh\" (UID: \"7e40d989-03b1-4bbd-bf07-5bacfcf48503\") " pod="cert-manager/cert-manager-55b4d954d5-rwphh" Sep 09 20:55:44.694517 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.694522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc8l8\" (UniqueName: \"kubernetes.io/projected/7e40d989-03b1-4bbd-bf07-5bacfcf48503-kube-api-access-kc8l8\") pod \"cert-manager-55b4d954d5-rwphh\" (UID: \"7e40d989-03b1-4bbd-bf07-5bacfcf48503\") " pod="cert-manager/cert-manager-55b4d954d5-rwphh" Sep 09 20:55:44.704372 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.704333 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e40d989-03b1-4bbd-bf07-5bacfcf48503-bound-sa-token\") pod \"cert-manager-55b4d954d5-rwphh\" (UID: \"7e40d989-03b1-4bbd-bf07-5bacfcf48503\") " pod="cert-manager/cert-manager-55b4d954d5-rwphh" Sep 09 20:55:44.704521 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.704502 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc8l8\" (UniqueName: \"kubernetes.io/projected/7e40d989-03b1-4bbd-bf07-5bacfcf48503-kube-api-access-kc8l8\") pod \"cert-manager-55b4d954d5-rwphh\" (UID: \"7e40d989-03b1-4bbd-bf07-5bacfcf48503\") " pod="cert-manager/cert-manager-55b4d954d5-rwphh" Sep 09 20:55:44.783339 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:44.783253 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rwphh" Sep 09 20:55:45.054568 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:45.054533 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rwphh"] Sep 09 20:55:45.057279 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:55:45.057247 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e40d989_03b1_4bbd_bf07_5bacfcf48503.slice/crio-0a7b5d061a6e7a1652addafd8c478cde5f6164ca6d0814fbec2906eae7628962 WatchSource:0}: Error finding container 0a7b5d061a6e7a1652addafd8c478cde5f6164ca6d0814fbec2906eae7628962: Status 404 returned error can't find the container with id 0a7b5d061a6e7a1652addafd8c478cde5f6164ca6d0814fbec2906eae7628962 Sep 09 20:55:45.690373 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:45.690325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rwphh" event={"ID":"7e40d989-03b1-4bbd-bf07-5bacfcf48503","Type":"ContainerStarted","Data":"0a7b5d061a6e7a1652addafd8c478cde5f6164ca6d0814fbec2906eae7628962"} Sep 09 20:55:47.645173 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.645087 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz"] Sep 09 20:55:47.647303 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.647288 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" Sep 09 20:55:47.649645 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.649616 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:55:47.649833 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.649616 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-svnzv\"" Sep 09 20:55:47.650497 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.650478 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 20:55:47.660590 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.660561 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz"] Sep 09 20:55:47.702881 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.702841 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rwphh" event={"ID":"7e40d989-03b1-4bbd-bf07-5bacfcf48503","Type":"ContainerStarted","Data":"0e7874968e4ac6490027df124a0911e8237e2bd998e6d2cd91332289ffcf30d9"} Sep 09 20:55:47.719581 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.719557 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch7jb\" (UniqueName: \"kubernetes.io/projected/998e5808-31c6-4802-bc7e-e0b2c72922d4-kube-api-access-ch7jb\") pod \"openshift-lws-operator-fd8ccff4c-nrgwz\" (UID: \"998e5808-31c6-4802-bc7e-e0b2c72922d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" Sep 09 20:55:47.719728 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.719599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/998e5808-31c6-4802-bc7e-e0b2c72922d4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nrgwz\" (UID: \"998e5808-31c6-4802-bc7e-e0b2c72922d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" Sep 09 20:55:47.724961 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.724916 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rwphh" podStartSLOduration=1.408401378 podStartE2EDuration="3.724901398s" totalImagesPullingTime="2.31650002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:55:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:55:47.722993122 +0000 UTC m=+510.324804692" watchObservedRunningTime="2026-09-09 20:55:47.724901398 +0000 UTC m=+510.326712969" Sep 09 20:55:47.820284 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.820252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/998e5808-31c6-4802-bc7e-e0b2c72922d4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nrgwz\" (UID: \"998e5808-31c6-4802-bc7e-e0b2c72922d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" Sep 09 20:55:47.820442 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.820323 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch7jb\" (UniqueName: \"kubernetes.io/projected/998e5808-31c6-4802-bc7e-e0b2c72922d4-kube-api-access-ch7jb\") pod \"openshift-lws-operator-fd8ccff4c-nrgwz\" (UID: \"998e5808-31c6-4802-bc7e-e0b2c72922d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" Sep 09 20:55:47.820661 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.820638 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/998e5808-31c6-4802-bc7e-e0b2c72922d4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nrgwz\" (UID: \"998e5808-31c6-4802-bc7e-e0b2c72922d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" Sep 09 20:55:47.829331 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.829298 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch7jb\" (UniqueName: \"kubernetes.io/projected/998e5808-31c6-4802-bc7e-e0b2c72922d4-kube-api-access-ch7jb\") pod \"openshift-lws-operator-fd8ccff4c-nrgwz\" (UID: \"998e5808-31c6-4802-bc7e-e0b2c72922d4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" Sep 09 20:55:47.955656 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:47.955585 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" Sep 09 20:55:48.232881 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:48.232802 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz"] Sep 09 20:55:48.236554 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:55:48.236527 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod998e5808_31c6_4802_bc7e_e0b2c72922d4.slice/crio-141cdd1c8ad892b5fe59157267b6d42078438819ce9965a339aa7bec4cf67cbc WatchSource:0}: Error finding container 141cdd1c8ad892b5fe59157267b6d42078438819ce9965a339aa7bec4cf67cbc: Status 404 returned error can't find the container with id 141cdd1c8ad892b5fe59157267b6d42078438819ce9965a339aa7bec4cf67cbc Sep 09 20:55:48.708851 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:48.708813 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" event={"ID":"998e5808-31c6-4802-bc7e-e0b2c72922d4","Type":"ContainerStarted","Data":"141cdd1c8ad892b5fe59157267b6d42078438819ce9965a339aa7bec4cf67cbc"} Sep 09 20:55:50.719896 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:50.719861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" event={"ID":"998e5808-31c6-4802-bc7e-e0b2c72922d4","Type":"ContainerStarted","Data":"9cb8d26778116fb3d38a08615730e844edb9f881c98623867774b3bbee4f1f05"} Sep 09 20:55:50.743608 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:50.743560 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrgwz" podStartSLOduration=2.065511963 podStartE2EDuration="3.743544466s" totalImagesPullingTime="1.678032503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:55:50.742124475 +0000 UTC m=+513.343936047" watchObservedRunningTime="2026-09-09 20:55:50.743544466 +0000 UTC m=+513.345356036" Sep 09 20:55:53.360332 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.360301 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv"] Sep 09 20:55:53.381769 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.381746 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv"] Sep 09 20:55:53.381899 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.381835 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.384184 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.384153 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 20:55:53.384932 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.384913 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 20:55:53.385050 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.384932 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bx95v\"" Sep 09 20:55:53.456971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.456947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.457094 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.456983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9njgj\" (UniqueName: \"kubernetes.io/projected/737294db-335f-4dfe-af74-698cb3dd156e-kube-api-access-9njgj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.457094 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.457004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.558185 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.558161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.558325 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.558202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9njgj\" (UniqueName: \"kubernetes.io/projected/737294db-335f-4dfe-af74-698cb3dd156e-kube-api-access-9njgj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.558325 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.558227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.558551 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.558530 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.558623 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.558581 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.566842 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.566819 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9njgj\" (UniqueName: \"kubernetes.io/projected/737294db-335f-4dfe-af74-698cb3dd156e-kube-api-access-9njgj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.690576 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.690500 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:53.980902 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:53.980826 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv"] Sep 09 20:55:53.983658 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:55:53.983636 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737294db_335f_4dfe_af74_698cb3dd156e.slice/crio-9521cd3cfbe3bbe06144c14f4e211026d858320d0b0ec6f63c6f98b3a2dc79fc WatchSource:0}: Error finding container 9521cd3cfbe3bbe06144c14f4e211026d858320d0b0ec6f63c6f98b3a2dc79fc: Status 404 returned error can't find the container with id 9521cd3cfbe3bbe06144c14f4e211026d858320d0b0ec6f63c6f98b3a2dc79fc Sep 09 20:55:54.739179 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:54.739147 2580 generic.go:356] "Generic (PLEG): container finished" podID="737294db-335f-4dfe-af74-698cb3dd156e" containerID="1acef2d79af9129c8a9cdbbe5358da8f121c77807f2944d93249a7e572ff7364" exitCode=0 Sep 09 20:55:54.739547 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:54.739228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" event={"ID":"737294db-335f-4dfe-af74-698cb3dd156e","Type":"ContainerDied","Data":"1acef2d79af9129c8a9cdbbe5358da8f121c77807f2944d93249a7e572ff7364"} Sep 09 20:55:54.739547 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:54.739270 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" event={"ID":"737294db-335f-4dfe-af74-698cb3dd156e","Type":"ContainerStarted","Data":"9521cd3cfbe3bbe06144c14f4e211026d858320d0b0ec6f63c6f98b3a2dc79fc"} Sep 09 20:55:55.745439 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:55.745372 2580 generic.go:356] "Generic (PLEG): container finished" podID="737294db-335f-4dfe-af74-698cb3dd156e" containerID="06ac3688b075b1e2ca795e335a314d0e363de1e07666170e9cf49d9ed8b6c2c5" exitCode=0 Sep 09 20:55:55.745439 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:55.745413 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" event={"ID":"737294db-335f-4dfe-af74-698cb3dd156e","Type":"ContainerDied","Data":"06ac3688b075b1e2ca795e335a314d0e363de1e07666170e9cf49d9ed8b6c2c5"} Sep 09 20:55:56.751105 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:56.751068 2580 generic.go:356] "Generic (PLEG): container finished" podID="737294db-335f-4dfe-af74-698cb3dd156e" containerID="a573c55ce56f3512c88b91e360cf48fe2c77b822497d975729a797ec45cbe96b" exitCode=0 Sep 09 20:55:56.751455 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:56.751153 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" event={"ID":"737294db-335f-4dfe-af74-698cb3dd156e","Type":"ContainerDied","Data":"a573c55ce56f3512c88b91e360cf48fe2c77b822497d975729a797ec45cbe96b"} Sep 09 20:55:57.882146 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.882123 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:55:57.891370 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.891348 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-bundle\") pod \"737294db-335f-4dfe-af74-698cb3dd156e\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " Sep 09 20:55:57.891498 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.891403 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-util\") pod \"737294db-335f-4dfe-af74-698cb3dd156e\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " Sep 09 20:55:57.891498 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.891430 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9njgj\" (UniqueName: \"kubernetes.io/projected/737294db-335f-4dfe-af74-698cb3dd156e-kube-api-access-9njgj\") pod \"737294db-335f-4dfe-af74-698cb3dd156e\" (UID: \"737294db-335f-4dfe-af74-698cb3dd156e\") " Sep 09 20:55:57.892029 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.892004 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-bundle" (OuterVolumeSpecName: "bundle") pod "737294db-335f-4dfe-af74-698cb3dd156e" (UID: "737294db-335f-4dfe-af74-698cb3dd156e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:55:57.893334 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.893308 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/737294db-335f-4dfe-af74-698cb3dd156e-kube-api-access-9njgj" (OuterVolumeSpecName: "kube-api-access-9njgj") pod "737294db-335f-4dfe-af74-698cb3dd156e" (UID: "737294db-335f-4dfe-af74-698cb3dd156e"). InnerVolumeSpecName "kube-api-access-9njgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:55:57.896856 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.896836 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-util" (OuterVolumeSpecName: "util") pod "737294db-335f-4dfe-af74-698cb3dd156e" (UID: "737294db-335f-4dfe-af74-698cb3dd156e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:55:57.992612 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.992585 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-util\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:55:57.992612 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.992609 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9njgj\" (UniqueName: \"kubernetes.io/projected/737294db-335f-4dfe-af74-698cb3dd156e-kube-api-access-9njgj\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:55:57.992612 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:57.992618 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/737294db-335f-4dfe-af74-698cb3dd156e-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:55:58.768292 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:58.768259 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" event={"ID":"737294db-335f-4dfe-af74-698cb3dd156e","Type":"ContainerDied","Data":"9521cd3cfbe3bbe06144c14f4e211026d858320d0b0ec6f63c6f98b3a2dc79fc"} Sep 09 20:55:58.768454 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:58.768304 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9521cd3cfbe3bbe06144c14f4e211026d858320d0b0ec6f63c6f98b3a2dc79fc" Sep 09 20:55:58.768454 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:55:58.768275 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aftbzkv" Sep 09 20:56:05.952674 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.952637 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb"] Sep 09 20:56:05.953254 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.953035 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="737294db-335f-4dfe-af74-698cb3dd156e" containerName="pull" Sep 09 20:56:05.953254 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.953055 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="737294db-335f-4dfe-af74-698cb3dd156e" containerName="pull" Sep 09 20:56:05.953254 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.953085 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="737294db-335f-4dfe-af74-698cb3dd156e" containerName="util" Sep 09 20:56:05.953254 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.953093 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="737294db-335f-4dfe-af74-698cb3dd156e" containerName="util" Sep 09 20:56:05.953254 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.953103 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="737294db-335f-4dfe-af74-698cb3dd156e" containerName="extract" Sep 09 20:56:05.953254 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.953112 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="737294db-335f-4dfe-af74-698cb3dd156e" containerName="extract" Sep 09 20:56:05.953254 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.953188 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="737294db-335f-4dfe-af74-698cb3dd156e" containerName="extract" Sep 09 20:56:05.955756 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.955731 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:05.958099 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.958077 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 20:56:05.958215 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.958199 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 20:56:05.959154 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.959138 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bx95v\"" Sep 09 20:56:05.968512 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:05.968492 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb"] Sep 09 20:56:06.048909 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.048870 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.049054 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.048936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.049054 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.049012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sk6j\" (UniqueName: \"kubernetes.io/projected/a413ff0d-c363-480d-8cb9-d0aba366130d-kube-api-access-2sk6j\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.149646 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.149620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sk6j\" (UniqueName: \"kubernetes.io/projected/a413ff0d-c363-480d-8cb9-d0aba366130d-kube-api-access-2sk6j\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.149743 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.149653 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.149743 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.149704 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.150080 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.150061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.150080 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.150073 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.158426 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.158400 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sk6j\" (UniqueName: \"kubernetes.io/projected/a413ff0d-c363-480d-8cb9-d0aba366130d-kube-api-access-2sk6j\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.265241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.265189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:06.533977 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.533952 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb"] Sep 09 20:56:06.536304 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:56:06.536271 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda413ff0d_c363_480d_8cb9_d0aba366130d.slice/crio-afb90be2895987cba61069c842a157865c520e18f14b8662d47ddab96c8605cb WatchSource:0}: Error finding container afb90be2895987cba61069c842a157865c520e18f14b8662d47ddab96c8605cb: Status 404 returned error can't find the container with id afb90be2895987cba61069c842a157865c520e18f14b8662d47ddab96c8605cb Sep 09 20:56:06.804692 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.804655 2580 generic.go:356] "Generic (PLEG): container finished" podID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerID="7e180e41e07e24f9a3423b6117bccc38d224045fe3f0bf4baf7ba4145b0769e1" exitCode=0 Sep 09 20:56:06.804845 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.804731 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" event={"ID":"a413ff0d-c363-480d-8cb9-d0aba366130d","Type":"ContainerDied","Data":"7e180e41e07e24f9a3423b6117bccc38d224045fe3f0bf4baf7ba4145b0769e1"} Sep 09 20:56:06.804845 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:06.804790 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" event={"ID":"a413ff0d-c363-480d-8cb9-d0aba366130d","Type":"ContainerStarted","Data":"afb90be2895987cba61069c842a157865c520e18f14b8662d47ddab96c8605cb"} Sep 09 20:56:07.811360 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:07.811325 2580 generic.go:356] "Generic (PLEG): container finished" podID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerID="fc3b2e59f23fd39ad264aaa5477abdb12a1762c97b73bb5123a5ef922c1571a0" exitCode=0 Sep 09 20:56:07.811765 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:07.811390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" event={"ID":"a413ff0d-c363-480d-8cb9-d0aba366130d","Type":"ContainerDied","Data":"fc3b2e59f23fd39ad264aaa5477abdb12a1762c97b73bb5123a5ef922c1571a0"} Sep 09 20:56:08.402952 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.402915 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh"] Sep 09 20:56:08.405195 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.405171 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.408143 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.408109 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 20:56:08.408382 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.408368 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 20:56:08.408672 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.408655 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 20:56:08.411020 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.411002 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-69dvb\"" Sep 09 20:56:08.419928 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.419908 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 20:56:08.462955 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.462929 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh"] Sep 09 20:56:08.468570 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.468544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqx5g\" (UniqueName: \"kubernetes.io/projected/178f361f-9172-40dd-b502-b84d32eea8ae-kube-api-access-lqx5g\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.468660 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.468591 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/178f361f-9172-40dd-b502-b84d32eea8ae-tmp\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.468660 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.468616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/178f361f-9172-40dd-b502-b84d32eea8ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.468743 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.468686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/178f361f-9172-40dd-b502-b84d32eea8ae-manifests\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.468743 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.468715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/178f361f-9172-40dd-b502-b84d32eea8ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.569392 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.569359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqx5g\" (UniqueName: \"kubernetes.io/projected/178f361f-9172-40dd-b502-b84d32eea8ae-kube-api-access-lqx5g\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.569558 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.569402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/178f361f-9172-40dd-b502-b84d32eea8ae-tmp\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.569558 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.569429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/178f361f-9172-40dd-b502-b84d32eea8ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.569558 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.569487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/178f361f-9172-40dd-b502-b84d32eea8ae-manifests\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.569558 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.569504 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/178f361f-9172-40dd-b502-b84d32eea8ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.569878 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.569852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/178f361f-9172-40dd-b502-b84d32eea8ae-manifests\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.571623 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.571602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/178f361f-9172-40dd-b502-b84d32eea8ae-tmp\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.571890 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.571871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/178f361f-9172-40dd-b502-b84d32eea8ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.571971 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.571953 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/178f361f-9172-40dd-b502-b84d32eea8ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.580813 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.580792 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqx5g\" (UniqueName: \"kubernetes.io/projected/178f361f-9172-40dd-b502-b84d32eea8ae-kube-api-access-lqx5g\") pod \"opendatahub-operator-controller-manager-97cf5684c-8zdvh\" (UID: \"178f361f-9172-40dd-b502-b84d32eea8ae\") " pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.715440 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.715369 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:08.817583 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.817547 2580 generic.go:356] "Generic (PLEG): container finished" podID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerID="f0c536fa00a9c993ca65a78f4d4422b961886442b6ec5107db330c2fc8e1238a" exitCode=0 Sep 09 20:56:08.817944 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.817628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" event={"ID":"a413ff0d-c363-480d-8cb9-d0aba366130d","Type":"ContainerDied","Data":"f0c536fa00a9c993ca65a78f4d4422b961886442b6ec5107db330c2fc8e1238a"} Sep 09 20:56:08.998009 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:08.997923 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh"] Sep 09 20:56:09.001917 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:56:09.001895 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178f361f_9172_40dd_b502_b84d32eea8ae.slice/crio-9fe3b471bb0cfad21925ee1c4e8cf0968af5a77597ddbebb4bd632da8630d1b9 WatchSource:0}: Error finding container 9fe3b471bb0cfad21925ee1c4e8cf0968af5a77597ddbebb4bd632da8630d1b9: Status 404 returned error can't find the container with id 9fe3b471bb0cfad21925ee1c4e8cf0968af5a77597ddbebb4bd632da8630d1b9 Sep 09 20:56:09.825797 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:09.825752 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" event={"ID":"178f361f-9172-40dd-b502-b84d32eea8ae","Type":"ContainerStarted","Data":"9fe3b471bb0cfad21925ee1c4e8cf0968af5a77597ddbebb4bd632da8630d1b9"} Sep 09 20:56:09.987035 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:09.986888 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:10.081691 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.081574 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-bundle\") pod \"a413ff0d-c363-480d-8cb9-d0aba366130d\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " Sep 09 20:56:10.081911 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.081715 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-util\") pod \"a413ff0d-c363-480d-8cb9-d0aba366130d\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " Sep 09 20:56:10.081911 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.081747 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sk6j\" (UniqueName: \"kubernetes.io/projected/a413ff0d-c363-480d-8cb9-d0aba366130d-kube-api-access-2sk6j\") pod \"a413ff0d-c363-480d-8cb9-d0aba366130d\" (UID: \"a413ff0d-c363-480d-8cb9-d0aba366130d\") " Sep 09 20:56:10.082502 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.082436 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-bundle" (OuterVolumeSpecName: "bundle") pod "a413ff0d-c363-480d-8cb9-d0aba366130d" (UID: "a413ff0d-c363-480d-8cb9-d0aba366130d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:56:10.085499 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.085433 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a413ff0d-c363-480d-8cb9-d0aba366130d-kube-api-access-2sk6j" (OuterVolumeSpecName: "kube-api-access-2sk6j") pod "a413ff0d-c363-480d-8cb9-d0aba366130d" (UID: "a413ff0d-c363-480d-8cb9-d0aba366130d"). InnerVolumeSpecName "kube-api-access-2sk6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:56:10.090537 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.090438 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-util" (OuterVolumeSpecName: "util") pod "a413ff0d-c363-480d-8cb9-d0aba366130d" (UID: "a413ff0d-c363-480d-8cb9-d0aba366130d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:56:10.182713 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.182672 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-util\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:10.182713 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.182709 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sk6j\" (UniqueName: \"kubernetes.io/projected/a413ff0d-c363-480d-8cb9-d0aba366130d-kube-api-access-2sk6j\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:10.182952 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.182727 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a413ff0d-c363-480d-8cb9-d0aba366130d-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:10.832762 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.832732 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" Sep 09 20:56:10.832762 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.832740 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0p2sqb" event={"ID":"a413ff0d-c363-480d-8cb9-d0aba366130d","Type":"ContainerDied","Data":"afb90be2895987cba61069c842a157865c520e18f14b8662d47ddab96c8605cb"} Sep 09 20:56:10.833239 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:10.832789 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afb90be2895987cba61069c842a157865c520e18f14b8662d47ddab96c8605cb" Sep 09 20:56:12.845962 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:12.845927 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" event={"ID":"178f361f-9172-40dd-b502-b84d32eea8ae","Type":"ContainerStarted","Data":"8650078d27b650880423a134ee1afd75da02ecd68e5defc993748e729d0e717d"} Sep 09 20:56:13.851685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:13.851641 2580 generic.go:356] "Generic (PLEG): container finished" podID="178f361f-9172-40dd-b502-b84d32eea8ae" containerID="8650078d27b650880423a134ee1afd75da02ecd68e5defc993748e729d0e717d" exitCode=0 Sep 09 20:56:13.852047 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:13.851728 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" event={"ID":"178f361f-9172-40dd-b502-b84d32eea8ae","Type":"ContainerDied","Data":"8650078d27b650880423a134ee1afd75da02ecd68e5defc993748e729d0e717d"} Sep 09 20:56:14.859821 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:14.859778 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" event={"ID":"178f361f-9172-40dd-b502-b84d32eea8ae","Type":"ContainerStarted","Data":"81ab89846ad93f86968516f7cac09ee6aa7d15223d4d37dbd4c54f8ad5edb72b"} Sep 09 20:56:14.860199 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:14.859946 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:14.881026 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:14.880974 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" podStartSLOduration=2.460853851 podStartE2EDuration="6.880953373s" totalImagesPullingTime="3.286996797s" totalInitContainerRuntime="1.133102725s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:14.879831708 +0000 UTC m=+537.481643279" watchObservedRunningTime="2026-09-09 20:56:14.880953373 +0000 UTC m=+537.482764944" Sep 09 20:56:25.867105 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:25.867067 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-97cf5684c-8zdvh" Sep 09 20:56:28.826722 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.826691 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn"] Sep 09 20:56:28.827162 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.827101 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerName="extract" Sep 09 20:56:28.827162 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.827119 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerName="extract" Sep 09 20:56:28.827162 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.827134 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerName="util" Sep 09 20:56:28.827162 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.827142 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerName="util" Sep 09 20:56:28.827162 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.827150 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerName="pull" Sep 09 20:56:28.827162 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.827157 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerName="pull" Sep 09 20:56:28.827450 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.827240 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a413ff0d-c363-480d-8cb9-d0aba366130d" containerName="extract" Sep 09 20:56:28.836807 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.836779 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:28.839808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.839780 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 20:56:28.839808 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.839794 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 09 20:56:28.840660 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.840640 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 09 20:56:28.840830 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.840718 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4hcrc\"" Sep 09 20:56:28.840985 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.840731 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 20:56:28.857521 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.857498 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn"] Sep 09 20:56:28.924942 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.924914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k27pd\" (UniqueName: \"kubernetes.io/projected/168ded2e-3923-4cca-b146-88c9ca180cf6-kube-api-access-k27pd\") pod \"kube-auth-proxy-7c789b6945-tbzdn\" (UID: \"168ded2e-3923-4cca-b146-88c9ca180cf6\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:28.925116 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.924956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/168ded2e-3923-4cca-b146-88c9ca180cf6-tls-certs\") pod \"kube-auth-proxy-7c789b6945-tbzdn\" (UID: \"168ded2e-3923-4cca-b146-88c9ca180cf6\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:28.925116 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:28.924972 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168ded2e-3923-4cca-b146-88c9ca180cf6-tmp\") pod \"kube-auth-proxy-7c789b6945-tbzdn\" (UID: \"168ded2e-3923-4cca-b146-88c9ca180cf6\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:29.026298 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:29.026267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k27pd\" (UniqueName: \"kubernetes.io/projected/168ded2e-3923-4cca-b146-88c9ca180cf6-kube-api-access-k27pd\") pod \"kube-auth-proxy-7c789b6945-tbzdn\" (UID: \"168ded2e-3923-4cca-b146-88c9ca180cf6\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:29.026426 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:29.026308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/168ded2e-3923-4cca-b146-88c9ca180cf6-tls-certs\") pod \"kube-auth-proxy-7c789b6945-tbzdn\" (UID: \"168ded2e-3923-4cca-b146-88c9ca180cf6\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:29.026426 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:29.026332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168ded2e-3923-4cca-b146-88c9ca180cf6-tmp\") pod \"kube-auth-proxy-7c789b6945-tbzdn\" (UID: \"168ded2e-3923-4cca-b146-88c9ca180cf6\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:29.028599 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:29.028578 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168ded2e-3923-4cca-b146-88c9ca180cf6-tmp\") pod \"kube-auth-proxy-7c789b6945-tbzdn\" (UID: \"168ded2e-3923-4cca-b146-88c9ca180cf6\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:29.028824 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:29.028804 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/168ded2e-3923-4cca-b146-88c9ca180cf6-tls-certs\") pod \"kube-auth-proxy-7c789b6945-tbzdn\" (UID: \"168ded2e-3923-4cca-b146-88c9ca180cf6\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:29.050372 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:29.050348 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k27pd\" (UniqueName: \"kubernetes.io/projected/168ded2e-3923-4cca-b146-88c9ca180cf6-kube-api-access-k27pd\") pod \"kube-auth-proxy-7c789b6945-tbzdn\" (UID: \"168ded2e-3923-4cca-b146-88c9ca180cf6\") " pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:29.147216 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:29.147161 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" Sep 09 20:56:29.429985 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:29.429955 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn"] Sep 09 20:56:29.432588 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:56:29.432560 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168ded2e_3923_4cca_b146_88c9ca180cf6.slice/crio-4e64fa0b6e1726debeabab01a3e9580ff8f7a45867ee49283f4cae45e42e3f53 WatchSource:0}: Error finding container 4e64fa0b6e1726debeabab01a3e9580ff8f7a45867ee49283f4cae45e42e3f53: Status 404 returned error can't find the container with id 4e64fa0b6e1726debeabab01a3e9580ff8f7a45867ee49283f4cae45e42e3f53 Sep 09 20:56:29.927338 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:29.927295 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" event={"ID":"168ded2e-3923-4cca-b146-88c9ca180cf6","Type":"ContainerStarted","Data":"4e64fa0b6e1726debeabab01a3e9580ff8f7a45867ee49283f4cae45e42e3f53"} Sep 09 20:56:30.316798 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.316766 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9"] Sep 09 20:56:30.320333 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.320311 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.323340 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.323207 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 09 20:56:30.323340 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.323267 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 09 20:56:30.323340 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.323277 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 20:56:30.323340 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.323270 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 09 20:56:30.323655 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.323570 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sj4lm\"" Sep 09 20:56:30.333844 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.333824 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9"] Sep 09 20:56:30.437418 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.437390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.437604 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.437434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.437604 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.437480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.437604 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.437528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pl4l\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-kube-api-access-2pl4l\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.437775 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.437595 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.437775 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.437648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.437775 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.437701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.538737 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.538706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.538911 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.538763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.538911 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.538795 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.538911 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.538818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.538911 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.538861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pl4l\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-kube-api-access-2pl4l\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.538911 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.538891 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.539158 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.538920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.539496 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.539419 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.542613 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.542585 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.542832 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.542808 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.542930 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.542850 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.543076 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.543055 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.549393 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.549368 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.557834 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.557808 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pl4l\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-kube-api-access-2pl4l\") pod \"istiod-openshift-gateway-7b7995d5cd-ggzn9\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.632520 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.632438 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:30.923384 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.923352 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9"] Sep 09 20:56:30.925610 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:56:30.925580 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7040d1_ae45_44d8_b158_ce96a79e3ebe.slice/crio-6ceae54d2e7276220cd7d1c5e40066c70f348f4ce1c59a3d518df10d6edf16a1 WatchSource:0}: Error finding container 6ceae54d2e7276220cd7d1c5e40066c70f348f4ce1c59a3d518df10d6edf16a1: Status 404 returned error can't find the container with id 6ceae54d2e7276220cd7d1c5e40066c70f348f4ce1c59a3d518df10d6edf16a1 Sep 09 20:56:30.934445 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:30.934350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" event={"ID":"6d7040d1-ae45-44d8-b158-ce96a79e3ebe","Type":"ContainerStarted","Data":"6ceae54d2e7276220cd7d1c5e40066c70f348f4ce1c59a3d518df10d6edf16a1"} Sep 09 20:56:32.946816 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:32.946760 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" event={"ID":"168ded2e-3923-4cca-b146-88c9ca180cf6","Type":"ContainerStarted","Data":"92b575a1c95754f6815f8c4b7eed9cd2110f34061fa4841ccba73f7037daa130"} Sep 09 20:56:32.964806 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:32.964751 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c789b6945-tbzdn" podStartSLOduration=1.901437736 podStartE2EDuration="4.964731188s" totalImagesPullingTime="3.063293452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:32.963817154 +0000 UTC m=+555.565628725" watchObservedRunningTime="2026-09-09 20:56:32.964731188 +0000 UTC m=+555.566542758" Sep 09 20:56:34.283370 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:34.283321 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 09 20:56:34.283678 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:34.283392 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"} Sep 09 20:56:34.958423 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:34.958387 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" event={"ID":"6d7040d1-ae45-44d8-b158-ce96a79e3ebe","Type":"ContainerStarted","Data":"c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c"} Sep 09 20:56:34.958594 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:34.958499 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:34.977625 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:34.977582 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" podStartSLOduration=1.622696935 podStartE2EDuration="4.977568236s" totalImagesPullingTime="3.354871301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:34.976887817 +0000 UTC m=+557.578699387" watchObservedRunningTime="2026-09-09 20:56:34.977568236 +0000 UTC m=+557.579379806" Sep 09 20:56:35.965046 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:35.965020 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:48.079515 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.079476 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2"] Sep 09 20:56:48.084475 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.084439 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.095244 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.095223 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 20:56:48.095362 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.095242 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4lv2q\"" Sep 09 20:56:48.095738 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.095713 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 20:56:48.100584 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.095943 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 20:56:48.184347 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.184313 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2"] Sep 09 20:56:48.196958 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.196926 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/527285d4-0d45-427f-94ce-c3012c997f06-manager-config\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.197095 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.196966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8vcm\" (UniqueName: \"kubernetes.io/projected/527285d4-0d45-427f-94ce-c3012c997f06-kube-api-access-l8vcm\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.197095 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.197060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/527285d4-0d45-427f-94ce-c3012c997f06-metrics-cert\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.197173 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.197121 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527285d4-0d45-427f-94ce-c3012c997f06-cert\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.298229 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.298190 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/527285d4-0d45-427f-94ce-c3012c997f06-metrics-cert\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.298382 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.298260 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527285d4-0d45-427f-94ce-c3012c997f06-cert\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.298382 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.298293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/527285d4-0d45-427f-94ce-c3012c997f06-manager-config\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.298382 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.298331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8vcm\" (UniqueName: \"kubernetes.io/projected/527285d4-0d45-427f-94ce-c3012c997f06-kube-api-access-l8vcm\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.299004 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.298973 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/527285d4-0d45-427f-94ce-c3012c997f06-manager-config\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.300822 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.300799 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/527285d4-0d45-427f-94ce-c3012c997f06-metrics-cert\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.300930 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.300852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/527285d4-0d45-427f-94ce-c3012c997f06-cert\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.312507 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.312442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8vcm\" (UniqueName: \"kubernetes.io/projected/527285d4-0d45-427f-94ce-c3012c997f06-kube-api-access-l8vcm\") pod \"lws-controller-manager-7596c9fb79-2bdf2\" (UID: \"527285d4-0d45-427f-94ce-c3012c997f06\") " pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.393448 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.393378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:48.700977 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:56:48.700938 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527285d4_0d45_427f_94ce_c3012c997f06.slice/crio-6f57f964ee2f912f4e133c8d74d18828a3059813a5e286f74178f3a74f42b4a2 WatchSource:0}: Error finding container 6f57f964ee2f912f4e133c8d74d18828a3059813a5e286f74178f3a74f42b4a2: Status 404 returned error can't find the container with id 6f57f964ee2f912f4e133c8d74d18828a3059813a5e286f74178f3a74f42b4a2 Sep 09 20:56:48.701394 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:48.701369 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2"] Sep 09 20:56:49.026380 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:49.026301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" event={"ID":"527285d4-0d45-427f-94ce-c3012c997f06","Type":"ContainerStarted","Data":"6f57f964ee2f912f4e133c8d74d18828a3059813a5e286f74178f3a74f42b4a2"} Sep 09 20:56:51.040618 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.040522 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" event={"ID":"527285d4-0d45-427f-94ce-c3012c997f06","Type":"ContainerStarted","Data":"ae2f4c0b5cf7a1c0638b94409e659f17afe504a0a6227998e7830140e71f86d1"} Sep 09 20:56:51.040957 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.040643 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:56:51.076169 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.076112 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" podStartSLOduration=2.1755183909999998 podStartE2EDuration="4.076097002s" totalImagesPullingTime="1.900578611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:56:51.074853959 +0000 UTC m=+573.676665530" watchObservedRunningTime="2026-09-09 20:56:51.076097002 +0000 UTC m=+573.677908572" Sep 09 20:56:51.410323 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.410289 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9"] Sep 09 20:56:51.410508 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.410481 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" podUID="6d7040d1-ae45-44d8-b158-ce96a79e3ebe" containerName="discovery" containerID="cri-o://c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c" gracePeriod=30 Sep 09 20:56:51.657199 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.657175 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:51.826104 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.826072 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pl4l\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-kube-api-access-2pl4l\") pod \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " Sep 09 20:56:51.826262 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.826128 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-cacerts\") pod \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " Sep 09 20:56:51.826262 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.826169 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-local-certs\") pod \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " Sep 09 20:56:51.826262 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.826202 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-dns-cert\") pod \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " Sep 09 20:56:51.826262 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.826233 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-kubeconfig\") pod \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " Sep 09 20:56:51.826505 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.826277 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-token\") pod \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " Sep 09 20:56:51.826505 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.826304 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-ca-configmap\") pod \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\" (UID: \"6d7040d1-ae45-44d8-b158-ce96a79e3ebe\") " Sep 09 20:56:51.827035 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.826988 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6d7040d1-ae45-44d8-b158-ce96a79e3ebe" (UID: "6d7040d1-ae45-44d8-b158-ce96a79e3ebe"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:56:51.829180 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.829103 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-kube-api-access-2pl4l" (OuterVolumeSpecName: "kube-api-access-2pl4l") pod "6d7040d1-ae45-44d8-b158-ce96a79e3ebe" (UID: "6d7040d1-ae45-44d8-b158-ce96a79e3ebe"). InnerVolumeSpecName "kube-api-access-2pl4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:56:51.829180 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.829105 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-cacerts" (OuterVolumeSpecName: "cacerts") pod "6d7040d1-ae45-44d8-b158-ce96a79e3ebe" (UID: "6d7040d1-ae45-44d8-b158-ce96a79e3ebe"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:56:51.829180 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.829161 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6d7040d1-ae45-44d8-b158-ce96a79e3ebe" (UID: "6d7040d1-ae45-44d8-b158-ce96a79e3ebe"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:56:51.829411 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.829229 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d7040d1-ae45-44d8-b158-ce96a79e3ebe" (UID: "6d7040d1-ae45-44d8-b158-ce96a79e3ebe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:56:51.829411 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.829349 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-local-certs" (OuterVolumeSpecName: "local-certs") pod "6d7040d1-ae45-44d8-b158-ce96a79e3ebe" (UID: "6d7040d1-ae45-44d8-b158-ce96a79e3ebe"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:56:51.829667 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.829642 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6d7040d1-ae45-44d8-b158-ce96a79e3ebe" (UID: "6d7040d1-ae45-44d8-b158-ce96a79e3ebe"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:56:51.927956 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.927905 2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-kubeconfig\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:51.927956 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.927959 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-token\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:51.928178 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.927975 2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-ca-configmap\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:51.928178 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.927990 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pl4l\" (UniqueName: \"kubernetes.io/projected/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-kube-api-access-2pl4l\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:51.928178 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.928005 2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-cacerts\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:51.928178 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.928017 2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-local-certs\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:51.928178 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:51.928031 2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6d7040d1-ae45-44d8-b158-ce96a79e3ebe-istio-csr-dns-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:56:52.050552 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:52.050512 2580 generic.go:356] "Generic (PLEG): container finished" podID="6d7040d1-ae45-44d8-b158-ce96a79e3ebe" containerID="c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c" exitCode=0 Sep 09 20:56:52.050998 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:52.050567 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" Sep 09 20:56:52.050998 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:52.050602 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" event={"ID":"6d7040d1-ae45-44d8-b158-ce96a79e3ebe","Type":"ContainerDied","Data":"c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c"} Sep 09 20:56:52.050998 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:52.050694 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9" event={"ID":"6d7040d1-ae45-44d8-b158-ce96a79e3ebe","Type":"ContainerDied","Data":"6ceae54d2e7276220cd7d1c5e40066c70f348f4ce1c59a3d518df10d6edf16a1"} Sep 09 20:56:52.050998 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:52.050724 2580 scope.go:117] "RemoveContainer" containerID="c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c" Sep 09 20:56:52.059117 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:52.059100 2580 scope.go:117] "RemoveContainer" containerID="c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c" Sep 09 20:56:52.059378 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:56:52.059362 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c\": container with ID starting with c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c not found: ID does not exist" containerID="c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c" Sep 09 20:56:52.059439 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:52.059388 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c"} err="failed to get container status \"c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c\": rpc error: code = NotFound desc = could not find container \"c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c\": container with ID starting with c2f2b4f2e0187467587123ee4d1973746fd9c50295c45b8020a4a5969a16a97c not found: ID does not exist" Sep 09 20:56:52.128241 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:52.128178 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9"] Sep 09 20:56:52.149266 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:52.149240 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ggzn9"] Sep 09 20:56:53.885845 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:56:53.885810 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d7040d1-ae45-44d8-b158-ce96a79e3ebe" path="/var/lib/kubelet/pods/6d7040d1-ae45-44d8-b158-ce96a79e3ebe/volumes" Sep 09 20:57:02.052738 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:02.052703 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7596c9fb79-2bdf2" Sep 09 20:57:11.290144 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.290106 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc9885ff6-4fpgn"] Sep 09 20:57:11.290550 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.290481 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7040d1-ae45-44d8-b158-ce96a79e3ebe" containerName="discovery" Sep 09 20:57:11.290550 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.290498 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7040d1-ae45-44d8-b158-ce96a79e3ebe" containerName="discovery" Sep 09 20:57:11.290623 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.290568 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d7040d1-ae45-44d8-b158-ce96a79e3ebe" containerName="discovery" Sep 09 20:57:11.297230 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.297213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.311671 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.311645 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc9885ff6-4fpgn"] Sep 09 20:57:11.373340 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.373310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-trusted-ca-bundle\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.373340 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.373342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-console-config\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.373543 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.373364 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20a4b751-1b22-4004-928e-c909df4d72da-console-oauth-config\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.373543 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.373439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz4cc\" (UniqueName: \"kubernetes.io/projected/20a4b751-1b22-4004-928e-c909df4d72da-kube-api-access-qz4cc\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.373543 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.373495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-oauth-serving-cert\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.373641 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.373587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-service-ca\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.373641 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.373629 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20a4b751-1b22-4004-928e-c909df4d72da-console-serving-cert\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.474703 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.474654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz4cc\" (UniqueName: \"kubernetes.io/projected/20a4b751-1b22-4004-928e-c909df4d72da-kube-api-access-qz4cc\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.474703 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.474709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-oauth-serving-cert\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.474921 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.474744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-service-ca\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.474921 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.474771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20a4b751-1b22-4004-928e-c909df4d72da-console-serving-cert\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.474921 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.474795 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-trusted-ca-bundle\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.474921 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.474810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-console-config\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.474921 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.474833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20a4b751-1b22-4004-928e-c909df4d72da-console-oauth-config\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.475857 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.475824 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-oauth-serving-cert\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.475965 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.475909 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-console-config\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.476025 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.475976 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-service-ca\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.476455 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.476431 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a4b751-1b22-4004-928e-c909df4d72da-trusted-ca-bundle\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.478209 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.478181 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20a4b751-1b22-4004-928e-c909df4d72da-console-serving-cert\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.482777 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.482754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20a4b751-1b22-4004-928e-c909df4d72da-console-oauth-config\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.484445 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.484425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz4cc\" (UniqueName: \"kubernetes.io/projected/20a4b751-1b22-4004-928e-c909df4d72da-kube-api-access-qz4cc\") pod \"console-7dc9885ff6-4fpgn\" (UID: \"20a4b751-1b22-4004-928e-c909df4d72da\") " pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.606630 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.606594 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:11.884980 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:57:11.884947 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a4b751_1b22_4004_928e_c909df4d72da.slice/crio-6f0dfc756221e4a7621e9f940a527ba7de7c334b4e134428ffffb0529bc883a7 WatchSource:0}: Error finding container 6f0dfc756221e4a7621e9f940a527ba7de7c334b4e134428ffffb0529bc883a7: Status 404 returned error can't find the container with id 6f0dfc756221e4a7621e9f940a527ba7de7c334b4e134428ffffb0529bc883a7 Sep 09 20:57:11.886576 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:11.886550 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc9885ff6-4fpgn"] Sep 09 20:57:12.149317 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:12.149211 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc9885ff6-4fpgn" event={"ID":"20a4b751-1b22-4004-928e-c909df4d72da","Type":"ContainerStarted","Data":"7a94b4ef67fa84ad9008aeacd2a09608bb95ffae4ceec6b07a88ced000fd6e1c"} Sep 09 20:57:12.149317 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:12.149271 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc9885ff6-4fpgn" event={"ID":"20a4b751-1b22-4004-928e-c909df4d72da","Type":"ContainerStarted","Data":"6f0dfc756221e4a7621e9f940a527ba7de7c334b4e134428ffffb0529bc883a7"} Sep 09 20:57:12.170389 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:12.170335 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc9885ff6-4fpgn" podStartSLOduration=1.170316429 podStartE2EDuration="1.170316429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:57:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:57:12.165158815 +0000 UTC m=+594.766970386" watchObservedRunningTime="2026-09-09 20:57:12.170316429 +0000 UTC m=+594.772128000" Sep 09 20:57:21.606979 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:21.606933 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:21.607391 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:21.607041 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:21.611635 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:21.611612 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:22.199293 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:22.199265 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc9885ff6-4fpgn" Sep 09 20:57:22.247286 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:22.247255 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58858945b4-n84b4"] Sep 09 20:57:44.496387 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.496303 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww"] Sep 09 20:57:44.499670 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.499652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.502272 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.502252 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 20:57:44.502404 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.502252 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bx95v\"" Sep 09 20:57:44.502842 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.502821 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 20:57:44.510402 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.510383 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww"] Sep 09 20:57:44.604479 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.604427 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr"] Sep 09 20:57:44.608182 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.608153 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.616455 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.616429 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr"] Sep 09 20:57:44.635763 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.635730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.635903 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.635766 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qrd7\" (UniqueName: \"kubernetes.io/projected/c421951a-1b1b-4869-9002-a148d7595d6f-kube-api-access-7qrd7\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.635903 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.635791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.694487 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.694440 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26"] Sep 09 20:57:44.697915 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.697894 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:44.706378 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.706353 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26"] Sep 09 20:57:44.736371 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.736340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.736535 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.736378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.736535 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.736420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.736535 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.736455 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qrd7\" (UniqueName: \"kubernetes.io/projected/c421951a-1b1b-4869-9002-a148d7595d6f-kube-api-access-7qrd7\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.736535 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.736506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.736686 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.736548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx524\" (UniqueName: \"kubernetes.io/projected/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-kube-api-access-cx524\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.736750 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.736730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.736892 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.736872 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.744767 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.744745 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qrd7\" (UniqueName: \"kubernetes.io/projected/c421951a-1b1b-4869-9002-a148d7595d6f-kube-api-access-7qrd7\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.799613 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.799576 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp"] Sep 09 20:57:44.805055 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.805029 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:44.808327 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.808308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:44.815497 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.815455 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp"] Sep 09 20:57:44.837977 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.837944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:44.838126 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.837992 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:44.838126 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.838014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqq6m\" (UniqueName: \"kubernetes.io/projected/28f2cbb6-4a31-4395-b141-c518c404a432-kube-api-access-mqq6m\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:44.838126 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.838114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx524\" (UniqueName: \"kubernetes.io/projected/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-kube-api-access-cx524\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.838252 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.838195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.838252 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.838222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.838667 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.838645 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.838721 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.838658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.846228 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.846183 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx524\" (UniqueName: \"kubernetes.io/projected/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-kube-api-access-cx524\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.918046 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.918006 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:44.939371 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.939338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:44.939593 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.939379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqq6m\" (UniqueName: \"kubernetes.io/projected/28f2cbb6-4a31-4395-b141-c518c404a432-kube-api-access-mqq6m\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:44.939593 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.939432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:44.939593 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.939457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x6gx\" (UniqueName: \"kubernetes.io/projected/19f54619-6be6-40ab-bccc-249cc41a2057-kube-api-access-8x6gx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:44.939762 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.939624 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:44.939762 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.939688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:44.939856 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.939769 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:44.940018 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.939998 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:44.948557 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:44.948527 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqq6m\" (UniqueName: \"kubernetes.io/projected/28f2cbb6-4a31-4395-b141-c518c404a432-kube-api-access-mqq6m\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:45.007807 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.007773 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:45.041193 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.041148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:45.041376 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.041203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x6gx\" (UniqueName: \"kubernetes.io/projected/19f54619-6be6-40ab-bccc-249cc41a2057-kube-api-access-8x6gx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:45.041376 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.041284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:45.041725 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.041679 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:45.041843 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.041764 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:45.049549 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.049524 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x6gx\" (UniqueName: \"kubernetes.io/projected/19f54619-6be6-40ab-bccc-249cc41a2057-kube-api-access-8x6gx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:45.086756 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.086726 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww"] Sep 09 20:57:45.088589 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:57:45.088562 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc421951a_1b1b_4869_9002_a148d7595d6f.slice/crio-07cda9e637bc5b5e28a84cff352c62fb6a0d768dd7bd60d10af6a4c425cd77c4 WatchSource:0}: Error finding container 07cda9e637bc5b5e28a84cff352c62fb6a0d768dd7bd60d10af6a4c425cd77c4: Status 404 returned error can't find the container with id 07cda9e637bc5b5e28a84cff352c62fb6a0d768dd7bd60d10af6a4c425cd77c4 Sep 09 20:57:45.115030 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.115004 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:45.227247 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.227208 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr"] Sep 09 20:57:45.255525 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:57:45.255482 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21b1c9e_eb1e_4d76_9da9_d72e290c0861.slice/crio-666b1c0ca4c60ef9ab5ff2eca9335f7e95b9dbed94f9719ccbc088f8ca458339 WatchSource:0}: Error finding container 666b1c0ca4c60ef9ab5ff2eca9335f7e95b9dbed94f9719ccbc088f8ca458339: Status 404 returned error can't find the container with id 666b1c0ca4c60ef9ab5ff2eca9335f7e95b9dbed94f9719ccbc088f8ca458339 Sep 09 20:57:45.280822 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.280788 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26"] Sep 09 20:57:45.283805 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:57:45.283772 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f2cbb6_4a31_4395_b141_c518c404a432.slice/crio-6fe98cf4bcd8d2d18690f33917786dcc7b92caeddc9fdf1172bb4ee9917b88b6 WatchSource:0}: Error finding container 6fe98cf4bcd8d2d18690f33917786dcc7b92caeddc9fdf1172bb4ee9917b88b6: Status 404 returned error can't find the container with id 6fe98cf4bcd8d2d18690f33917786dcc7b92caeddc9fdf1172bb4ee9917b88b6 Sep 09 20:57:45.305710 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.305681 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" event={"ID":"c21b1c9e-eb1e-4d76-9da9-d72e290c0861","Type":"ContainerStarted","Data":"666b1c0ca4c60ef9ab5ff2eca9335f7e95b9dbed94f9719ccbc088f8ca458339"} Sep 09 20:57:45.307477 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.307390 2580 generic.go:356] "Generic (PLEG): container finished" podID="c421951a-1b1b-4869-9002-a148d7595d6f" containerID="848c62ea3c5dead2468fda3753fc9c59819d867a7c6b8a19b1dc871d1304169b" exitCode=0 Sep 09 20:57:45.307477 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.307439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" event={"ID":"c421951a-1b1b-4869-9002-a148d7595d6f","Type":"ContainerDied","Data":"848c62ea3c5dead2468fda3753fc9c59819d867a7c6b8a19b1dc871d1304169b"} Sep 09 20:57:45.307628 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.307535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" event={"ID":"c421951a-1b1b-4869-9002-a148d7595d6f","Type":"ContainerStarted","Data":"07cda9e637bc5b5e28a84cff352c62fb6a0d768dd7bd60d10af6a4c425cd77c4"} Sep 09 20:57:45.308712 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.308689 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:57:45.308802 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.308755 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" event={"ID":"28f2cbb6-4a31-4395-b141-c518c404a432","Type":"ContainerStarted","Data":"6fe98cf4bcd8d2d18690f33917786dcc7b92caeddc9fdf1172bb4ee9917b88b6"} Sep 09 20:57:45.396493 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:45.396450 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp"] Sep 09 20:57:45.455304 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:57:45.455270 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f54619_6be6_40ab_bccc_249cc41a2057.slice/crio-28dda9b9a93473f2d128229aa77eb5f2049b24fb561ddfe406aac6f93cfe4c83 WatchSource:0}: Error finding container 28dda9b9a93473f2d128229aa77eb5f2049b24fb561ddfe406aac6f93cfe4c83: Status 404 returned error can't find the container with id 28dda9b9a93473f2d128229aa77eb5f2049b24fb561ddfe406aac6f93cfe4c83 Sep 09 20:57:46.314246 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:46.314215 2580 generic.go:356] "Generic (PLEG): container finished" podID="28f2cbb6-4a31-4395-b141-c518c404a432" containerID="463308d78870e284facfc8af6b64d32b9c2d028a315cb56be53f42f0aae41727" exitCode=0 Sep 09 20:57:46.314690 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:46.314302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" event={"ID":"28f2cbb6-4a31-4395-b141-c518c404a432","Type":"ContainerDied","Data":"463308d78870e284facfc8af6b64d32b9c2d028a315cb56be53f42f0aae41727"} Sep 09 20:57:46.316023 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:46.316004 2580 generic.go:356] "Generic (PLEG): container finished" podID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerID="262c7ee34b5bc1e52455cca3229a511505f408fc4b1c4551240e4cf5aa22f6ce" exitCode=0 Sep 09 20:57:46.316107 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:46.316075 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" event={"ID":"c21b1c9e-eb1e-4d76-9da9-d72e290c0861","Type":"ContainerDied","Data":"262c7ee34b5bc1e52455cca3229a511505f408fc4b1c4551240e4cf5aa22f6ce"} Sep 09 20:57:46.317760 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:46.317690 2580 generic.go:356] "Generic (PLEG): container finished" podID="19f54619-6be6-40ab-bccc-249cc41a2057" containerID="48a233d239589143fdc4d33dd0d430a02df3a5651aa332b985270290825994c8" exitCode=0 Sep 09 20:57:46.317760 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:46.317718 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" event={"ID":"19f54619-6be6-40ab-bccc-249cc41a2057","Type":"ContainerDied","Data":"48a233d239589143fdc4d33dd0d430a02df3a5651aa332b985270290825994c8"} Sep 09 20:57:46.317760 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:46.317768 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" event={"ID":"19f54619-6be6-40ab-bccc-249cc41a2057","Type":"ContainerStarted","Data":"28dda9b9a93473f2d128229aa77eb5f2049b24fb561ddfe406aac6f93cfe4c83"} Sep 09 20:57:47.267416 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.267374 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58858945b4-n84b4" podUID="b3f31644-4416-461a-918c-f1132bffd9d3" containerName="console" containerID="cri-o://efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c" gracePeriod=15 Sep 09 20:57:47.324151 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.324113 2580 generic.go:356] "Generic (PLEG): container finished" podID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerID="fbb566b019ca0ee87dbeed79b7c819e334db1eb58460dcd20c670ac7ed4d0d2e" exitCode=0 Sep 09 20:57:47.324563 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.324193 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" event={"ID":"c21b1c9e-eb1e-4d76-9da9-d72e290c0861","Type":"ContainerDied","Data":"fbb566b019ca0ee87dbeed79b7c819e334db1eb58460dcd20c670ac7ed4d0d2e"} Sep 09 20:57:47.326122 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.326096 2580 generic.go:356] "Generic (PLEG): container finished" podID="19f54619-6be6-40ab-bccc-249cc41a2057" containerID="119d3bf2e8d6b675492e08929b2a6ca84b487896093c30f37130cf5312431dd2" exitCode=0 Sep 09 20:57:47.326239 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.326158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" event={"ID":"19f54619-6be6-40ab-bccc-249cc41a2057","Type":"ContainerDied","Data":"119d3bf2e8d6b675492e08929b2a6ca84b487896093c30f37130cf5312431dd2"} Sep 09 20:57:47.333661 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.333034 2580 generic.go:356] "Generic (PLEG): container finished" podID="c421951a-1b1b-4869-9002-a148d7595d6f" containerID="f526cb7b868b43538b338940b66086237745e1c9cc61a8fb3efcac977d2e705f" exitCode=0 Sep 09 20:57:47.333661 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.333124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" event={"ID":"c421951a-1b1b-4869-9002-a148d7595d6f","Type":"ContainerDied","Data":"f526cb7b868b43538b338940b66086237745e1c9cc61a8fb3efcac977d2e705f"} Sep 09 20:57:47.687207 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.687132 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:57:47.768732 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.768692 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-trusted-ca-bundle\") pod \"b3f31644-4416-461a-918c-f1132bffd9d3\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " Sep 09 20:57:47.768874 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.768761 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-oauth-serving-cert\") pod \"b3f31644-4416-461a-918c-f1132bffd9d3\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " Sep 09 20:57:47.768874 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.768783 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-console-config\") pod \"b3f31644-4416-461a-918c-f1132bffd9d3\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " Sep 09 20:57:47.768981 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.768950 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-serving-cert\") pod \"b3f31644-4416-461a-918c-f1132bffd9d3\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " Sep 09 20:57:47.769038 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769005 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s49kq\" (UniqueName: \"kubernetes.io/projected/b3f31644-4416-461a-918c-f1132bffd9d3-kube-api-access-s49kq\") pod \"b3f31644-4416-461a-918c-f1132bffd9d3\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " Sep 09 20:57:47.769093 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769044 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-service-ca\") pod \"b3f31644-4416-461a-918c-f1132bffd9d3\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " Sep 09 20:57:47.769093 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769086 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-oauth-config\") pod \"b3f31644-4416-461a-918c-f1132bffd9d3\" (UID: \"b3f31644-4416-461a-918c-f1132bffd9d3\") " Sep 09 20:57:47.769196 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769133 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-console-config" (OuterVolumeSpecName: "console-config") pod "b3f31644-4416-461a-918c-f1132bffd9d3" (UID: "b3f31644-4416-461a-918c-f1132bffd9d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:57:47.769253 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769193 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b3f31644-4416-461a-918c-f1132bffd9d3" (UID: "b3f31644-4416-461a-918c-f1132bffd9d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:57:47.769253 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769202 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3f31644-4416-461a-918c-f1132bffd9d3" (UID: "b3f31644-4416-461a-918c-f1132bffd9d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:57:47.769452 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769425 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3f31644-4416-461a-918c-f1132bffd9d3" (UID: "b3f31644-4416-461a-918c-f1132bffd9d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:57:47.769568 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769546 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-service-ca\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:47.769623 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769564 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-trusted-ca-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:47.769623 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769578 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-oauth-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:47.769623 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.769586 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3f31644-4416-461a-918c-f1132bffd9d3-console-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:47.771068 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.771039 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3f31644-4416-461a-918c-f1132bffd9d3-kube-api-access-s49kq" (OuterVolumeSpecName: "kube-api-access-s49kq") pod "b3f31644-4416-461a-918c-f1132bffd9d3" (UID: "b3f31644-4416-461a-918c-f1132bffd9d3"). InnerVolumeSpecName "kube-api-access-s49kq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:57:47.771159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.771095 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3f31644-4416-461a-918c-f1132bffd9d3" (UID: "b3f31644-4416-461a-918c-f1132bffd9d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:57:47.771159 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.771112 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3f31644-4416-461a-918c-f1132bffd9d3" (UID: "b3f31644-4416-461a-918c-f1132bffd9d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:57:47.870868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.870827 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-serving-cert\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:47.870868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.870863 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s49kq\" (UniqueName: \"kubernetes.io/projected/b3f31644-4416-461a-918c-f1132bffd9d3-kube-api-access-s49kq\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:47.870868 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:47.870876 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3f31644-4416-461a-918c-f1132bffd9d3-console-oauth-config\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:48.340292 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.340252 2580 generic.go:356] "Generic (PLEG): container finished" podID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerID="9ce4b4fdcb2b07758d439a0697508fd26e4a206e8cf6fd962b837153945e3004" exitCode=0 Sep 09 20:57:48.340721 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.340337 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" event={"ID":"c21b1c9e-eb1e-4d76-9da9-d72e290c0861","Type":"ContainerDied","Data":"9ce4b4fdcb2b07758d439a0697508fd26e4a206e8cf6fd962b837153945e3004"} Sep 09 20:57:48.342450 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.342424 2580 generic.go:356] "Generic (PLEG): container finished" podID="19f54619-6be6-40ab-bccc-249cc41a2057" containerID="8093bdcf758947f50ca414ea77b1bdffc4bb7eb695bca3d7c696086701d3870b" exitCode=0 Sep 09 20:57:48.342588 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.342452 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" event={"ID":"19f54619-6be6-40ab-bccc-249cc41a2057","Type":"ContainerDied","Data":"8093bdcf758947f50ca414ea77b1bdffc4bb7eb695bca3d7c696086701d3870b"} Sep 09 20:57:48.344578 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.344557 2580 generic.go:356] "Generic (PLEG): container finished" podID="c421951a-1b1b-4869-9002-a148d7595d6f" containerID="646aea0ee31ee4895a0cd4ca9cb7908f2b4cbfa0091e529e7d77578be9acddff" exitCode=0 Sep 09 20:57:48.344695 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.344644 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" event={"ID":"c421951a-1b1b-4869-9002-a148d7595d6f","Type":"ContainerDied","Data":"646aea0ee31ee4895a0cd4ca9cb7908f2b4cbfa0091e529e7d77578be9acddff"} Sep 09 20:57:48.346375 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.346323 2580 generic.go:356] "Generic (PLEG): container finished" podID="28f2cbb6-4a31-4395-b141-c518c404a432" containerID="2b454a969837a46d94ecaefee6ca04f892300894265097154a6fbfa9c4594eff" exitCode=0 Sep 09 20:57:48.346375 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.346351 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" event={"ID":"28f2cbb6-4a31-4395-b141-c518c404a432","Type":"ContainerDied","Data":"2b454a969837a46d94ecaefee6ca04f892300894265097154a6fbfa9c4594eff"} Sep 09 20:57:48.347849 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.347830 2580 generic.go:356] "Generic (PLEG): container finished" podID="b3f31644-4416-461a-918c-f1132bffd9d3" containerID="efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c" exitCode=0 Sep 09 20:57:48.347949 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.347882 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58858945b4-n84b4" event={"ID":"b3f31644-4416-461a-918c-f1132bffd9d3","Type":"ContainerDied","Data":"efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c"} Sep 09 20:57:48.347949 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.347890 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58858945b4-n84b4" Sep 09 20:57:48.347949 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.347913 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58858945b4-n84b4" event={"ID":"b3f31644-4416-461a-918c-f1132bffd9d3","Type":"ContainerDied","Data":"6cb7dd4b99a19f87343b1e3f15027da93168f540dce061189d829e6989315887"} Sep 09 20:57:48.347949 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.347938 2580 scope.go:117] "RemoveContainer" containerID="efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c" Sep 09 20:57:48.356559 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.356544 2580 scope.go:117] "RemoveContainer" containerID="efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c" Sep 09 20:57:48.356828 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:57:48.356811 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c\": container with ID starting with efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c not found: ID does not exist" containerID="efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c" Sep 09 20:57:48.356883 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.356839 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c"} err="failed to get container status \"efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c\": rpc error: code = NotFound desc = could not find container \"efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c\": container with ID starting with efb0e312f11fb46f6ccbb9735122fa38b559cb91b58074a56fb684a0955cc89c not found: ID does not exist" Sep 09 20:57:48.481535 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.481500 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58858945b4-n84b4"] Sep 09 20:57:48.484738 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:48.484708 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58858945b4-n84b4"] Sep 09 20:57:49.355914 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.355881 2580 generic.go:356] "Generic (PLEG): container finished" podID="28f2cbb6-4a31-4395-b141-c518c404a432" containerID="cfe4da0fb9a67a93fa9c9190942270aca0d63b530f7e8c8e10a02bc907b6cc11" exitCode=0 Sep 09 20:57:49.356346 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.355967 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" event={"ID":"28f2cbb6-4a31-4395-b141-c518c404a432","Type":"ContainerDied","Data":"cfe4da0fb9a67a93fa9c9190942270aca0d63b530f7e8c8e10a02bc907b6cc11"} Sep 09 20:57:49.497029 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.497002 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:49.549500 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.549451 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:49.552150 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.552126 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:49.588240 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.588203 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-util\") pod \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " Sep 09 20:57:49.588364 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.588306 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-bundle\") pod \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " Sep 09 20:57:49.588364 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.588356 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx524\" (UniqueName: \"kubernetes.io/projected/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-kube-api-access-cx524\") pod \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\" (UID: \"c21b1c9e-eb1e-4d76-9da9-d72e290c0861\") " Sep 09 20:57:49.588787 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.588757 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-bundle" (OuterVolumeSpecName: "bundle") pod "c21b1c9e-eb1e-4d76-9da9-d72e290c0861" (UID: "c21b1c9e-eb1e-4d76-9da9-d72e290c0861"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:57:49.590524 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.590496 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-kube-api-access-cx524" (OuterVolumeSpecName: "kube-api-access-cx524") pod "c21b1c9e-eb1e-4d76-9da9-d72e290c0861" (UID: "c21b1c9e-eb1e-4d76-9da9-d72e290c0861"). InnerVolumeSpecName "kube-api-access-cx524". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:57:49.594717 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.594674 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-util" (OuterVolumeSpecName: "util") pod "c21b1c9e-eb1e-4d76-9da9-d72e290c0861" (UID: "c21b1c9e-eb1e-4d76-9da9-d72e290c0861"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:57:49.689647 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.689557 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-util\") pod \"19f54619-6be6-40ab-bccc-249cc41a2057\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " Sep 09 20:57:49.689647 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.689629 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-bundle\") pod \"19f54619-6be6-40ab-bccc-249cc41a2057\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " Sep 09 20:57:49.689823 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.689674 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x6gx\" (UniqueName: \"kubernetes.io/projected/19f54619-6be6-40ab-bccc-249cc41a2057-kube-api-access-8x6gx\") pod \"19f54619-6be6-40ab-bccc-249cc41a2057\" (UID: \"19f54619-6be6-40ab-bccc-249cc41a2057\") " Sep 09 20:57:49.689823 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.689704 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-bundle\") pod \"c421951a-1b1b-4869-9002-a148d7595d6f\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " Sep 09 20:57:49.689823 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.689733 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-util\") pod \"c421951a-1b1b-4869-9002-a148d7595d6f\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " Sep 09 20:57:49.689946 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.689908 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qrd7\" (UniqueName: \"kubernetes.io/projected/c421951a-1b1b-4869-9002-a148d7595d6f-kube-api-access-7qrd7\") pod \"c421951a-1b1b-4869-9002-a148d7595d6f\" (UID: \"c421951a-1b1b-4869-9002-a148d7595d6f\") " Sep 09 20:57:49.690204 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.690178 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx524\" (UniqueName: \"kubernetes.io/projected/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-kube-api-access-cx524\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:49.690296 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.690212 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-util\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:49.690296 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.690227 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c21b1c9e-eb1e-4d76-9da9-d72e290c0861-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:49.690296 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.690180 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-bundle" (OuterVolumeSpecName: "bundle") pod "19f54619-6be6-40ab-bccc-249cc41a2057" (UID: "19f54619-6be6-40ab-bccc-249cc41a2057"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:57:49.690296 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.690253 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-bundle" (OuterVolumeSpecName: "bundle") pod "c421951a-1b1b-4869-9002-a148d7595d6f" (UID: "c421951a-1b1b-4869-9002-a148d7595d6f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:57:49.691918 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.691895 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19f54619-6be6-40ab-bccc-249cc41a2057-kube-api-access-8x6gx" (OuterVolumeSpecName: "kube-api-access-8x6gx") pod "19f54619-6be6-40ab-bccc-249cc41a2057" (UID: "19f54619-6be6-40ab-bccc-249cc41a2057"). InnerVolumeSpecName "kube-api-access-8x6gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:57:49.692291 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.692275 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c421951a-1b1b-4869-9002-a148d7595d6f-kube-api-access-7qrd7" (OuterVolumeSpecName: "kube-api-access-7qrd7") pod "c421951a-1b1b-4869-9002-a148d7595d6f" (UID: "c421951a-1b1b-4869-9002-a148d7595d6f"). InnerVolumeSpecName "kube-api-access-7qrd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:57:49.695404 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.695384 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-util" (OuterVolumeSpecName: "util") pod "19f54619-6be6-40ab-bccc-249cc41a2057" (UID: "19f54619-6be6-40ab-bccc-249cc41a2057"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:57:49.696286 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.696266 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-util" (OuterVolumeSpecName: "util") pod "c421951a-1b1b-4869-9002-a148d7595d6f" (UID: "c421951a-1b1b-4869-9002-a148d7595d6f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:57:49.791619 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.791581 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:49.791619 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.791610 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c421951a-1b1b-4869-9002-a148d7595d6f-util\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:49.791619 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.791619 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qrd7\" (UniqueName: \"kubernetes.io/projected/c421951a-1b1b-4869-9002-a148d7595d6f-kube-api-access-7qrd7\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:49.791820 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.791630 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-util\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:49.791820 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.791638 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19f54619-6be6-40ab-bccc-249cc41a2057-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:49.791820 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.791647 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x6gx\" (UniqueName: \"kubernetes.io/projected/19f54619-6be6-40ab-bccc-249cc41a2057-kube-api-access-8x6gx\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:49.885406 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:49.885360 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3f31644-4416-461a-918c-f1132bffd9d3" path="/var/lib/kubelet/pods/b3f31644-4416-461a-918c-f1132bffd9d3/volumes" Sep 09 20:57:50.363553 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.363523 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" Sep 09 20:57:50.364031 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.363518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79r9vr" event={"ID":"c21b1c9e-eb1e-4d76-9da9-d72e290c0861","Type":"ContainerDied","Data":"666b1c0ca4c60ef9ab5ff2eca9335f7e95b9dbed94f9719ccbc088f8ca458339"} Sep 09 20:57:50.364031 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.363640 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="666b1c0ca4c60ef9ab5ff2eca9335f7e95b9dbed94f9719ccbc088f8ca458339" Sep 09 20:57:50.365905 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.365881 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" Sep 09 20:57:50.365905 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.365891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gc4rp" event={"ID":"19f54619-6be6-40ab-bccc-249cc41a2057","Type":"ContainerDied","Data":"28dda9b9a93473f2d128229aa77eb5f2049b24fb561ddfe406aac6f93cfe4c83"} Sep 09 20:57:50.366036 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.365931 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28dda9b9a93473f2d128229aa77eb5f2049b24fb561ddfe406aac6f93cfe4c83" Sep 09 20:57:50.368156 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.368133 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" event={"ID":"c421951a-1b1b-4869-9002-a148d7595d6f","Type":"ContainerDied","Data":"07cda9e637bc5b5e28a84cff352c62fb6a0d768dd7bd60d10af6a4c425cd77c4"} Sep 09 20:57:50.368284 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.368181 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07cda9e637bc5b5e28a84cff352c62fb6a0d768dd7bd60d10af6a4c425cd77c4" Sep 09 20:57:50.368284 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.368275 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c2ncww" Sep 09 20:57:50.497067 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.497044 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:50.598502 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.598449 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqq6m\" (UniqueName: \"kubernetes.io/projected/28f2cbb6-4a31-4395-b141-c518c404a432-kube-api-access-mqq6m\") pod \"28f2cbb6-4a31-4395-b141-c518c404a432\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " Sep 09 20:57:50.598664 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.598514 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-util\") pod \"28f2cbb6-4a31-4395-b141-c518c404a432\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " Sep 09 20:57:50.598664 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.598613 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-bundle\") pod \"28f2cbb6-4a31-4395-b141-c518c404a432\" (UID: \"28f2cbb6-4a31-4395-b141-c518c404a432\") " Sep 09 20:57:50.599234 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.599211 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-bundle" (OuterVolumeSpecName: "bundle") pod "28f2cbb6-4a31-4395-b141-c518c404a432" (UID: "28f2cbb6-4a31-4395-b141-c518c404a432"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:57:50.600561 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.600533 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28f2cbb6-4a31-4395-b141-c518c404a432-kube-api-access-mqq6m" (OuterVolumeSpecName: "kube-api-access-mqq6m") pod "28f2cbb6-4a31-4395-b141-c518c404a432" (UID: "28f2cbb6-4a31-4395-b141-c518c404a432"). InnerVolumeSpecName "kube-api-access-mqq6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:57:50.603728 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.603690 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-util" (OuterVolumeSpecName: "util") pod "28f2cbb6-4a31-4395-b141-c518c404a432" (UID: "28f2cbb6-4a31-4395-b141-c518c404a432"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:57:50.699524 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.699420 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-bundle\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:50.699524 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.699448 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqq6m\" (UniqueName: \"kubernetes.io/projected/28f2cbb6-4a31-4395-b141-c518c404a432-kube-api-access-mqq6m\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:50.699524 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:50.699487 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28f2cbb6-4a31-4395-b141-c518c404a432-util\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:57:51.375156 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:51.375121 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" event={"ID":"28f2cbb6-4a31-4395-b141-c518c404a432","Type":"ContainerDied","Data":"6fe98cf4bcd8d2d18690f33917786dcc7b92caeddc9fdf1172bb4ee9917b88b6"} Sep 09 20:57:51.375563 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:51.375164 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afqr26" Sep 09 20:57:51.375563 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:57:51.375169 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fe98cf4bcd8d2d18690f33917786dcc7b92caeddc9fdf1172bb4ee9917b88b6" Sep 09 20:58:12.500853 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.500815 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx"] Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501121 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f54619-6be6-40ab-bccc-249cc41a2057" containerName="pull" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501132 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f54619-6be6-40ab-bccc-249cc41a2057" containerName="pull" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501144 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c421951a-1b1b-4869-9002-a148d7595d6f" containerName="util" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501149 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c421951a-1b1b-4869-9002-a148d7595d6f" containerName="util" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501156 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerName="extract" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501162 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerName="extract" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501170 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerName="util" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501175 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerName="util" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501182 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28f2cbb6-4a31-4395-b141-c518c404a432" containerName="extract" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501188 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28f2cbb6-4a31-4395-b141-c518c404a432" containerName="extract" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501196 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f54619-6be6-40ab-bccc-249cc41a2057" containerName="util" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501201 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f54619-6be6-40ab-bccc-249cc41a2057" containerName="util" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501208 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerName="pull" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501214 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerName="pull" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501225 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c421951a-1b1b-4869-9002-a148d7595d6f" containerName="pull" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501230 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c421951a-1b1b-4869-9002-a148d7595d6f" containerName="pull" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501237 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c421951a-1b1b-4869-9002-a148d7595d6f" containerName="extract" Sep 09 20:58:12.501236 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501242 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c421951a-1b1b-4869-9002-a148d7595d6f" containerName="extract" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501250 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3f31644-4416-461a-918c-f1132bffd9d3" containerName="console" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501255 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3f31644-4416-461a-918c-f1132bffd9d3" containerName="console" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501263 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28f2cbb6-4a31-4395-b141-c518c404a432" containerName="util" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501269 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28f2cbb6-4a31-4395-b141-c518c404a432" containerName="util" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501275 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f54619-6be6-40ab-bccc-249cc41a2057" containerName="extract" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501280 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f54619-6be6-40ab-bccc-249cc41a2057" containerName="extract" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501285 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28f2cbb6-4a31-4395-b141-c518c404a432" containerName="pull" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501290 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28f2cbb6-4a31-4395-b141-c518c404a432" containerName="pull" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501337 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19f54619-6be6-40ab-bccc-249cc41a2057" containerName="extract" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501345 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28f2cbb6-4a31-4395-b141-c518c404a432" containerName="extract" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501350 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c21b1c9e-eb1e-4d76-9da9-d72e290c0861" containerName="extract" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501358 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3f31644-4416-461a-918c-f1132bffd9d3" containerName="console" Sep 09 20:58:12.501840 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.501363 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c421951a-1b1b-4869-9002-a148d7595d6f" containerName="extract" Sep 09 20:58:12.505801 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.505754 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.508930 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.508906 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fc772\"" Sep 09 20:58:12.509248 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.509226 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 20:58:12.510004 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.509971 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 09 20:58:12.510097 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.510015 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 09 20:58:12.510134 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.509982 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 20:58:12.517016 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.516993 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx"] Sep 09 20:58:12.572863 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.572824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e9c895-a29f-46c0-bf66-536bd890e4ca-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-zfsqx\" (UID: \"c8e9c895-a29f-46c0-bf66-536bd890e4ca\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.572863 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.572860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ztks\" (UniqueName: \"kubernetes.io/projected/c8e9c895-a29f-46c0-bf66-536bd890e4ca-kube-api-access-7ztks\") pod \"kuadrant-console-plugin-fbdd4f445-zfsqx\" (UID: \"c8e9c895-a29f-46c0-bf66-536bd890e4ca\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.573046 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.572894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8e9c895-a29f-46c0-bf66-536bd890e4ca-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-zfsqx\" (UID: \"c8e9c895-a29f-46c0-bf66-536bd890e4ca\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.673880 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.673834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e9c895-a29f-46c0-bf66-536bd890e4ca-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-zfsqx\" (UID: \"c8e9c895-a29f-46c0-bf66-536bd890e4ca\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.673880 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.673883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztks\" (UniqueName: \"kubernetes.io/projected/c8e9c895-a29f-46c0-bf66-536bd890e4ca-kube-api-access-7ztks\") pod \"kuadrant-console-plugin-fbdd4f445-zfsqx\" (UID: \"c8e9c895-a29f-46c0-bf66-536bd890e4ca\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.674151 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.673923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8e9c895-a29f-46c0-bf66-536bd890e4ca-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-zfsqx\" (UID: \"c8e9c895-a29f-46c0-bf66-536bd890e4ca\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.674656 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.674630 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8e9c895-a29f-46c0-bf66-536bd890e4ca-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-zfsqx\" (UID: \"c8e9c895-a29f-46c0-bf66-536bd890e4ca\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.676292 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.676267 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8e9c895-a29f-46c0-bf66-536bd890e4ca-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-zfsqx\" (UID: \"c8e9c895-a29f-46c0-bf66-536bd890e4ca\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.691105 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.691076 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ztks\" (UniqueName: \"kubernetes.io/projected/c8e9c895-a29f-46c0-bf66-536bd890e4ca-kube-api-access-7ztks\") pod \"kuadrant-console-plugin-fbdd4f445-zfsqx\" (UID: \"c8e9c895-a29f-46c0-bf66-536bd890e4ca\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:12.816755 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:12.816716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" Sep 09 20:58:13.110040 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:13.110014 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx"] Sep 09 20:58:13.112812 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:58:13.112781 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8e9c895_a29f_46c0_bf66_536bd890e4ca.slice/crio-a8d7ba21ce90c16af4df5c2c5c61a85c8a09ad8d8ece5356acbfd2588f8c4f30 WatchSource:0}: Error finding container a8d7ba21ce90c16af4df5c2c5c61a85c8a09ad8d8ece5356acbfd2588f8c4f30: Status 404 returned error can't find the container with id a8d7ba21ce90c16af4df5c2c5c61a85c8a09ad8d8ece5356acbfd2588f8c4f30 Sep 09 20:58:13.492549 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:13.492447 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" event={"ID":"c8e9c895-a29f-46c0-bf66-536bd890e4ca","Type":"ContainerStarted","Data":"a8d7ba21ce90c16af4df5c2c5c61a85c8a09ad8d8ece5356acbfd2588f8c4f30"} Sep 09 20:58:18.523801 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:18.523766 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" event={"ID":"c8e9c895-a29f-46c0-bf66-536bd890e4ca","Type":"ContainerStarted","Data":"89f389677008e224cbae1bc298b31d5b23ffa6d5c3abd76ce866c75db6b2f855"} Sep 09 20:58:18.554105 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:18.554060 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zfsqx" podStartSLOduration=1.73495277 podStartE2EDuration="6.554044987s" totalImagesPullingTime="4.819092217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:58:18.553313778 +0000 UTC m=+661.155125339" watchObservedRunningTime="2026-09-09 20:58:18.554044987 +0000 UTC m=+661.155856559" Sep 09 20:58:57.758900 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:57.758864 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9x2p8"] Sep 09 20:58:57.777476 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:57.777418 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9x2p8"] Sep 09 20:58:57.777637 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:57.777526 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" Sep 09 20:58:57.780391 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:57.780368 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dzwms\"" Sep 09 20:58:57.902720 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:57.902693 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-7nrr5"] Sep 09 20:58:57.906111 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:57.906087 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7nrr5" Sep 09 20:58:57.911591 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:57.911563 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7nrr5"] Sep 09 20:58:57.938746 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:57.938714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vcsn\" (UniqueName: \"kubernetes.io/projected/51bbb219-39b5-482a-8ee4-06251be9f93a-kube-api-access-7vcsn\") pod \"authorino-7bcfd8f9cd-9x2p8\" (UID: \"51bbb219-39b5-482a-8ee4-06251be9f93a\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" Sep 09 20:58:58.039717 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.039642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vcsn\" (UniqueName: \"kubernetes.io/projected/51bbb219-39b5-482a-8ee4-06251be9f93a-kube-api-access-7vcsn\") pod \"authorino-7bcfd8f9cd-9x2p8\" (UID: \"51bbb219-39b5-482a-8ee4-06251be9f93a\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" Sep 09 20:58:58.039842 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.039728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhj9w\" (UniqueName: \"kubernetes.io/projected/5677af11-86c6-425a-9ba2-f4d922ee9f28-kube-api-access-mhj9w\") pod \"authorino-59c974bd48-7nrr5\" (UID: \"5677af11-86c6-425a-9ba2-f4d922ee9f28\") " pod="kuadrant-system/authorino-59c974bd48-7nrr5" Sep 09 20:58:58.049669 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.049652 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vcsn\" (UniqueName: \"kubernetes.io/projected/51bbb219-39b5-482a-8ee4-06251be9f93a-kube-api-access-7vcsn\") pod \"authorino-7bcfd8f9cd-9x2p8\" (UID: \"51bbb219-39b5-482a-8ee4-06251be9f93a\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" Sep 09 20:58:58.086409 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.086386 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" Sep 09 20:58:58.141569 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.141217 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhj9w\" (UniqueName: \"kubernetes.io/projected/5677af11-86c6-425a-9ba2-f4d922ee9f28-kube-api-access-mhj9w\") pod \"authorino-59c974bd48-7nrr5\" (UID: \"5677af11-86c6-425a-9ba2-f4d922ee9f28\") " pod="kuadrant-system/authorino-59c974bd48-7nrr5" Sep 09 20:58:58.150674 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.150651 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhj9w\" (UniqueName: \"kubernetes.io/projected/5677af11-86c6-425a-9ba2-f4d922ee9f28-kube-api-access-mhj9w\") pod \"authorino-59c974bd48-7nrr5\" (UID: \"5677af11-86c6-425a-9ba2-f4d922ee9f28\") " pod="kuadrant-system/authorino-59c974bd48-7nrr5" Sep 09 20:58:58.216589 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.216563 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7nrr5" Sep 09 20:58:58.352761 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.352738 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9x2p8"] Sep 09 20:58:58.354338 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:58:58.354315 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51bbb219_39b5_482a_8ee4_06251be9f93a.slice/crio-ecfacdfad18fdf06993a3eb3106a48deeb68bdb3fc1ce3e472a3d898b49a7505 WatchSource:0}: Error finding container ecfacdfad18fdf06993a3eb3106a48deeb68bdb3fc1ce3e472a3d898b49a7505: Status 404 returned error can't find the container with id ecfacdfad18fdf06993a3eb3106a48deeb68bdb3fc1ce3e472a3d898b49a7505 Sep 09 20:58:58.489334 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.489311 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7nrr5"] Sep 09 20:58:58.490805 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:58:58.490781 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5677af11_86c6_425a_9ba2_f4d922ee9f28.slice/crio-9752fb4d03d42dce1e70c85545f0b731a865b3457a8f9f43e6e5aaa8ee1c51cd WatchSource:0}: Error finding container 9752fb4d03d42dce1e70c85545f0b731a865b3457a8f9f43e6e5aaa8ee1c51cd: Status 404 returned error can't find the container with id 9752fb4d03d42dce1e70c85545f0b731a865b3457a8f9f43e6e5aaa8ee1c51cd Sep 09 20:58:58.719829 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.719761 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7nrr5" event={"ID":"5677af11-86c6-425a-9ba2-f4d922ee9f28","Type":"ContainerStarted","Data":"9752fb4d03d42dce1e70c85545f0b731a865b3457a8f9f43e6e5aaa8ee1c51cd"} Sep 09 20:58:58.721008 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:58:58.720984 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" event={"ID":"51bbb219-39b5-482a-8ee4-06251be9f93a","Type":"ContainerStarted","Data":"ecfacdfad18fdf06993a3eb3106a48deeb68bdb3fc1ce3e472a3d898b49a7505"} Sep 09 20:59:01.744887 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:01.744791 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7nrr5" event={"ID":"5677af11-86c6-425a-9ba2-f4d922ee9f28","Type":"ContainerStarted","Data":"4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904"} Sep 09 20:59:01.746527 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:01.746498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" event={"ID":"51bbb219-39b5-482a-8ee4-06251be9f93a","Type":"ContainerStarted","Data":"e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73"} Sep 09 20:59:01.760176 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:01.760119 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-7nrr5" podStartSLOduration=1.797716067 podStartE2EDuration="4.760103633s" totalImagesPullingTime="2.962387566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:59:01.75805593 +0000 UTC m=+704.359867503" watchObservedRunningTime="2026-09-09 20:59:01.760103633 +0000 UTC m=+704.361915203" Sep 09 20:59:01.773981 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:01.773929 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" podStartSLOduration=1.663673395 podStartE2EDuration="4.773914714s" totalImagesPullingTime="3.110241319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:59:01.771097976 +0000 UTC m=+704.372909549" watchObservedRunningTime="2026-09-09 20:59:01.773914714 +0000 UTC m=+704.375726289" Sep 09 20:59:01.793685 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:01.793650 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9x2p8"] Sep 09 20:59:03.756963 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:03.756920 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" podUID="51bbb219-39b5-482a-8ee4-06251be9f93a" containerName="authorino" containerID="cri-o://e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73" gracePeriod=30 Sep 09 20:59:04.002612 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.002588 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" Sep 09 20:59:04.086517 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.086490 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vcsn\" (UniqueName: \"kubernetes.io/projected/51bbb219-39b5-482a-8ee4-06251be9f93a-kube-api-access-7vcsn\") pod \"51bbb219-39b5-482a-8ee4-06251be9f93a\" (UID: \"51bbb219-39b5-482a-8ee4-06251be9f93a\") " Sep 09 20:59:04.088507 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.088483 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51bbb219-39b5-482a-8ee4-06251be9f93a-kube-api-access-7vcsn" (OuterVolumeSpecName: "kube-api-access-7vcsn") pod "51bbb219-39b5-482a-8ee4-06251be9f93a" (UID: "51bbb219-39b5-482a-8ee4-06251be9f93a"). InnerVolumeSpecName "kube-api-access-7vcsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:59:04.187413 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.187375 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vcsn\" (UniqueName: \"kubernetes.io/projected/51bbb219-39b5-482a-8ee4-06251be9f93a-kube-api-access-7vcsn\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:59:04.763259 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.763223 2580 generic.go:356] "Generic (PLEG): container finished" podID="51bbb219-39b5-482a-8ee4-06251be9f93a" containerID="e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73" exitCode=0 Sep 09 20:59:04.763670 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.763269 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" Sep 09 20:59:04.763670 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.763309 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" event={"ID":"51bbb219-39b5-482a-8ee4-06251be9f93a","Type":"ContainerDied","Data":"e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73"} Sep 09 20:59:04.763670 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.763350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9x2p8" event={"ID":"51bbb219-39b5-482a-8ee4-06251be9f93a","Type":"ContainerDied","Data":"ecfacdfad18fdf06993a3eb3106a48deeb68bdb3fc1ce3e472a3d898b49a7505"} Sep 09 20:59:04.763670 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.763370 2580 scope.go:117] "RemoveContainer" containerID="e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73" Sep 09 20:59:04.772418 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.772397 2580 scope.go:117] "RemoveContainer" containerID="e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73" Sep 09 20:59:04.772710 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:59:04.772686 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73\": container with ID starting with e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73 not found: ID does not exist" containerID="e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73" Sep 09 20:59:04.772758 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.772713 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73"} err="failed to get container status \"e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73\": rpc error: code = NotFound desc = could not find container \"e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73\": container with ID starting with e6c19c81d5a0b0aebe86af496385b3da337f1b5576afeae9d1b0fea111ac5b73 not found: ID does not exist" Sep 09 20:59:04.783867 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.783839 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9x2p8"] Sep 09 20:59:04.787263 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:04.787237 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9x2p8"] Sep 09 20:59:05.885865 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:05.885830 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51bbb219-39b5-482a-8ee4-06251be9f93a" path="/var/lib/kubelet/pods/51bbb219-39b5-482a-8ee4-06251be9f93a/volumes" Sep 09 20:59:26.137994 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.137964 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-49rbs"] Sep 09 20:59:26.138454 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.138234 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51bbb219-39b5-482a-8ee4-06251be9f93a" containerName="authorino" Sep 09 20:59:26.138454 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.138245 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="51bbb219-39b5-482a-8ee4-06251be9f93a" containerName="authorino" Sep 09 20:59:26.138454 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.138304 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="51bbb219-39b5-482a-8ee4-06251be9f93a" containerName="authorino" Sep 09 20:59:26.142220 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.142204 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-49rbs" Sep 09 20:59:26.163077 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.163052 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-49rbs"] Sep 09 20:59:26.264746 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.264713 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqggg\" (UniqueName: \"kubernetes.io/projected/4263b51a-362c-47f0-a4ef-c83dfb1934fd-kube-api-access-rqggg\") pod \"authorino-557f876f69-49rbs\" (UID: \"4263b51a-362c-47f0-a4ef-c83dfb1934fd\") " pod="kuadrant-system/authorino-557f876f69-49rbs" Sep 09 20:59:26.365921 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.365893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqggg\" (UniqueName: \"kubernetes.io/projected/4263b51a-362c-47f0-a4ef-c83dfb1934fd-kube-api-access-rqggg\") pod \"authorino-557f876f69-49rbs\" (UID: \"4263b51a-362c-47f0-a4ef-c83dfb1934fd\") " pod="kuadrant-system/authorino-557f876f69-49rbs" Sep 09 20:59:26.377493 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.377449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqggg\" (UniqueName: \"kubernetes.io/projected/4263b51a-362c-47f0-a4ef-c83dfb1934fd-kube-api-access-rqggg\") pod \"authorino-557f876f69-49rbs\" (UID: \"4263b51a-362c-47f0-a4ef-c83dfb1934fd\") " pod="kuadrant-system/authorino-557f876f69-49rbs" Sep 09 20:59:26.390940 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.390887 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-49rbs"] Sep 09 20:59:26.391071 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.391060 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-49rbs" Sep 09 20:59:26.429855 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.429078 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cd8cd64fd-2vjpx"] Sep 09 20:59:26.433171 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.433150 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" Sep 09 20:59:26.450099 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.450037 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cd8cd64fd-2vjpx"] Sep 09 20:59:26.567773 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.567741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fnj5\" (UniqueName: \"kubernetes.io/projected/38912dbd-93c1-430b-8ac0-e2432a8c286d-kube-api-access-7fnj5\") pod \"authorino-6cd8cd64fd-2vjpx\" (UID: \"38912dbd-93c1-430b-8ac0-e2432a8c286d\") " pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" Sep 09 20:59:26.669044 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.668973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fnj5\" (UniqueName: \"kubernetes.io/projected/38912dbd-93c1-430b-8ac0-e2432a8c286d-kube-api-access-7fnj5\") pod \"authorino-6cd8cd64fd-2vjpx\" (UID: \"38912dbd-93c1-430b-8ac0-e2432a8c286d\") " pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" Sep 09 20:59:26.674642 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.674618 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-49rbs"] Sep 09 20:59:26.675406 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:59:26.675386 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4263b51a_362c_47f0_a4ef_c83dfb1934fd.slice/crio-f3757f5dd9f86c29c22d030e1b363a1d72e702369b40859bda13664e507007f7 WatchSource:0}: Error finding container f3757f5dd9f86c29c22d030e1b363a1d72e702369b40859bda13664e507007f7: Status 404 returned error can't find the container with id f3757f5dd9f86c29c22d030e1b363a1d72e702369b40859bda13664e507007f7 Sep 09 20:59:26.679631 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.679608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fnj5\" (UniqueName: \"kubernetes.io/projected/38912dbd-93c1-430b-8ac0-e2432a8c286d-kube-api-access-7fnj5\") pod \"authorino-6cd8cd64fd-2vjpx\" (UID: \"38912dbd-93c1-430b-8ac0-e2432a8c286d\") " pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" Sep 09 20:59:26.744891 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.744866 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" Sep 09 20:59:26.878606 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:26.878571 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-49rbs" event={"ID":"4263b51a-362c-47f0-a4ef-c83dfb1934fd","Type":"ContainerStarted","Data":"f3757f5dd9f86c29c22d030e1b363a1d72e702369b40859bda13664e507007f7"} Sep 09 20:59:27.028595 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:27.028572 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cd8cd64fd-2vjpx"] Sep 09 20:59:27.030770 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:59:27.030739 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38912dbd_93c1_430b_8ac0_e2432a8c286d.slice/crio-8a2f65ac4acbb01660f33e09d9da25460b3c1de4a2ab12ec6f26f57938086da7 WatchSource:0}: Error finding container 8a2f65ac4acbb01660f33e09d9da25460b3c1de4a2ab12ec6f26f57938086da7: Status 404 returned error can't find the container with id 8a2f65ac4acbb01660f33e09d9da25460b3c1de4a2ab12ec6f26f57938086da7 Sep 09 20:59:27.886130 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:27.886093 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-49rbs" podUID="4263b51a-362c-47f0-a4ef-c83dfb1934fd" containerName="authorino" containerID="cri-o://d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb" gracePeriod=30 Sep 09 20:59:27.887298 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:27.887269 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-49rbs" event={"ID":"4263b51a-362c-47f0-a4ef-c83dfb1934fd","Type":"ContainerStarted","Data":"d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb"} Sep 09 20:59:27.887775 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:27.887743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" event={"ID":"38912dbd-93c1-430b-8ac0-e2432a8c286d","Type":"ContainerStarted","Data":"65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e"} Sep 09 20:59:27.887775 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:27.887773 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" event={"ID":"38912dbd-93c1-430b-8ac0-e2432a8c286d","Type":"ContainerStarted","Data":"8a2f65ac4acbb01660f33e09d9da25460b3c1de4a2ab12ec6f26f57938086da7"} Sep 09 20:59:27.917710 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:27.917670 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-49rbs" podStartSLOduration=1.346235197 podStartE2EDuration="1.917655517s" totalImagesPullingTime="571.42032ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:59:27.916398821 +0000 UTC m=+730.518210394" watchObservedRunningTime="2026-09-09 20:59:27.917655517 +0000 UTC m=+730.519467088" Sep 09 20:59:27.944443 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:27.944403 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" podStartSLOduration=1.261847581 podStartE2EDuration="1.944390165s" totalImagesPullingTime="682.542584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:59:27.942784762 +0000 UTC m=+730.544596332" watchObservedRunningTime="2026-09-09 20:59:27.944390165 +0000 UTC m=+730.546201735" Sep 09 20:59:28.022305 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.022276 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7nrr5"] Sep 09 20:59:28.022508 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.022486 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-7nrr5" podUID="5677af11-86c6-425a-9ba2-f4d922ee9f28" containerName="authorino" containerID="cri-o://4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904" gracePeriod=30 Sep 09 20:59:28.134260 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.134141 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-49rbs" Sep 09 20:59:28.246358 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.246335 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7nrr5" Sep 09 20:59:28.266005 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.265955 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68789d458d-774d7"] Sep 09 20:59:28.266269 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.266257 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5677af11-86c6-425a-9ba2-f4d922ee9f28" containerName="authorino" Sep 09 20:59:28.266313 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.266272 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5677af11-86c6-425a-9ba2-f4d922ee9f28" containerName="authorino" Sep 09 20:59:28.266313 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.266289 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4263b51a-362c-47f0-a4ef-c83dfb1934fd" containerName="authorino" Sep 09 20:59:28.266313 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.266294 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4263b51a-362c-47f0-a4ef-c83dfb1934fd" containerName="authorino" Sep 09 20:59:28.266412 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.266343 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5677af11-86c6-425a-9ba2-f4d922ee9f28" containerName="authorino" Sep 09 20:59:28.266412 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.266352 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4263b51a-362c-47f0-a4ef-c83dfb1934fd" containerName="authorino" Sep 09 20:59:28.271532 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.270215 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68789d458d-774d7" Sep 09 20:59:28.273089 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.273064 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 09 20:59:28.283013 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.282991 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqggg\" (UniqueName: \"kubernetes.io/projected/4263b51a-362c-47f0-a4ef-c83dfb1934fd-kube-api-access-rqggg\") pod \"4263b51a-362c-47f0-a4ef-c83dfb1934fd\" (UID: \"4263b51a-362c-47f0-a4ef-c83dfb1934fd\") " Sep 09 20:59:28.284928 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.284904 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4263b51a-362c-47f0-a4ef-c83dfb1934fd-kube-api-access-rqggg" (OuterVolumeSpecName: "kube-api-access-rqggg") pod "4263b51a-362c-47f0-a4ef-c83dfb1934fd" (UID: "4263b51a-362c-47f0-a4ef-c83dfb1934fd"). InnerVolumeSpecName "kube-api-access-rqggg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:59:28.302411 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.302387 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68789d458d-774d7"] Sep 09 20:59:28.383916 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.383898 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhj9w\" (UniqueName: \"kubernetes.io/projected/5677af11-86c6-425a-9ba2-f4d922ee9f28-kube-api-access-mhj9w\") pod \"5677af11-86c6-425a-9ba2-f4d922ee9f28\" (UID: \"5677af11-86c6-425a-9ba2-f4d922ee9f28\") " Sep 09 20:59:28.384051 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.384030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmtdj\" (UniqueName: \"kubernetes.io/projected/6d90585b-c714-4317-b76d-780a9005d6e6-kube-api-access-bmtdj\") pod \"authorino-68789d458d-774d7\" (UID: \"6d90585b-c714-4317-b76d-780a9005d6e6\") " pod="kuadrant-system/authorino-68789d458d-774d7" Sep 09 20:59:28.384128 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.384078 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d90585b-c714-4317-b76d-780a9005d6e6-tls-cert\") pod \"authorino-68789d458d-774d7\" (UID: \"6d90585b-c714-4317-b76d-780a9005d6e6\") " pod="kuadrant-system/authorino-68789d458d-774d7" Sep 09 20:59:28.384239 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.384213 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqggg\" (UniqueName: \"kubernetes.io/projected/4263b51a-362c-47f0-a4ef-c83dfb1934fd-kube-api-access-rqggg\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:59:28.385984 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.385965 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5677af11-86c6-425a-9ba2-f4d922ee9f28-kube-api-access-mhj9w" (OuterVolumeSpecName: "kube-api-access-mhj9w") pod "5677af11-86c6-425a-9ba2-f4d922ee9f28" (UID: "5677af11-86c6-425a-9ba2-f4d922ee9f28"). InnerVolumeSpecName "kube-api-access-mhj9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:59:28.484851 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.484826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmtdj\" (UniqueName: \"kubernetes.io/projected/6d90585b-c714-4317-b76d-780a9005d6e6-kube-api-access-bmtdj\") pod \"authorino-68789d458d-774d7\" (UID: \"6d90585b-c714-4317-b76d-780a9005d6e6\") " pod="kuadrant-system/authorino-68789d458d-774d7" Sep 09 20:59:28.484947 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.484863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d90585b-c714-4317-b76d-780a9005d6e6-tls-cert\") pod \"authorino-68789d458d-774d7\" (UID: \"6d90585b-c714-4317-b76d-780a9005d6e6\") " pod="kuadrant-system/authorino-68789d458d-774d7" Sep 09 20:59:28.484947 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.484889 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhj9w\" (UniqueName: \"kubernetes.io/projected/5677af11-86c6-425a-9ba2-f4d922ee9f28-kube-api-access-mhj9w\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:59:28.487113 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.487096 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d90585b-c714-4317-b76d-780a9005d6e6-tls-cert\") pod \"authorino-68789d458d-774d7\" (UID: \"6d90585b-c714-4317-b76d-780a9005d6e6\") " pod="kuadrant-system/authorino-68789d458d-774d7" Sep 09 20:59:28.494439 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.494416 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmtdj\" (UniqueName: \"kubernetes.io/projected/6d90585b-c714-4317-b76d-780a9005d6e6-kube-api-access-bmtdj\") pod \"authorino-68789d458d-774d7\" (UID: \"6d90585b-c714-4317-b76d-780a9005d6e6\") " pod="kuadrant-system/authorino-68789d458d-774d7" Sep 09 20:59:28.580867 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.580845 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68789d458d-774d7" Sep 09 20:59:28.894576 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.894491 2580 generic.go:356] "Generic (PLEG): container finished" podID="4263b51a-362c-47f0-a4ef-c83dfb1934fd" containerID="d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb" exitCode=0 Sep 09 20:59:28.894576 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.894538 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-49rbs" Sep 09 20:59:28.895059 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.894575 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-49rbs" event={"ID":"4263b51a-362c-47f0-a4ef-c83dfb1934fd","Type":"ContainerDied","Data":"d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb"} Sep 09 20:59:28.895059 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.894617 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-49rbs" event={"ID":"4263b51a-362c-47f0-a4ef-c83dfb1934fd","Type":"ContainerDied","Data":"f3757f5dd9f86c29c22d030e1b363a1d72e702369b40859bda13664e507007f7"} Sep 09 20:59:28.895059 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.894639 2580 scope.go:117] "RemoveContainer" containerID="d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb" Sep 09 20:59:28.896254 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.896232 2580 generic.go:356] "Generic (PLEG): container finished" podID="5677af11-86c6-425a-9ba2-f4d922ee9f28" containerID="4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904" exitCode=0 Sep 09 20:59:28.896377 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.896295 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7nrr5" Sep 09 20:59:28.896377 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.896314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7nrr5" event={"ID":"5677af11-86c6-425a-9ba2-f4d922ee9f28","Type":"ContainerDied","Data":"4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904"} Sep 09 20:59:28.896377 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.896348 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7nrr5" event={"ID":"5677af11-86c6-425a-9ba2-f4d922ee9f28","Type":"ContainerDied","Data":"9752fb4d03d42dce1e70c85545f0b731a865b3457a8f9f43e6e5aaa8ee1c51cd"} Sep 09 20:59:28.904344 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.904325 2580 scope.go:117] "RemoveContainer" containerID="d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb" Sep 09 20:59:28.904675 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:59:28.904657 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb\": container with ID starting with d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb not found: ID does not exist" containerID="d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb" Sep 09 20:59:28.904752 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.904684 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb"} err="failed to get container status \"d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb\": rpc error: code = NotFound desc = could not find container \"d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb\": container with ID starting with d5885c65ebaa0a427f59cf3a0525188516644a43db5f4555c061170fbc16d4bb not found: ID does not exist" Sep 09 20:59:28.904752 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.904704 2580 scope.go:117] "RemoveContainer" containerID="4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904" Sep 09 20:59:28.912443 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.912397 2580 scope.go:117] "RemoveContainer" containerID="4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904" Sep 09 20:59:28.912708 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:59:28.912686 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904\": container with ID starting with 4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904 not found: ID does not exist" containerID="4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904" Sep 09 20:59:28.912767 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.912716 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904"} err="failed to get container status \"4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904\": rpc error: code = NotFound desc = could not find container \"4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904\": container with ID starting with 4ed937089d66d2c6f45a9f1cbaa369fdf6875a1c3f72867c59f469f04b976904 not found: ID does not exist" Sep 09 20:59:28.925343 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.925320 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68789d458d-774d7"] Sep 09 20:59:28.926319 ip-10-0-132-118 kubenswrapper[2580]: W0909 20:59:28.926294 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d90585b_c714_4317_b76d_780a9005d6e6.slice/crio-0ee217e7daec69f488e080bd94abd8bad849f0d593f410984269982d4385523b WatchSource:0}: Error finding container 0ee217e7daec69f488e080bd94abd8bad849f0d593f410984269982d4385523b: Status 404 returned error can't find the container with id 0ee217e7daec69f488e080bd94abd8bad849f0d593f410984269982d4385523b Sep 09 20:59:28.989800 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:28.989760 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7nrr5"] Sep 09 20:59:29.009973 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.009942 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7nrr5"] Sep 09 20:59:29.052433 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.052397 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-49rbs"] Sep 09 20:59:29.073041 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.073002 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-49rbs"] Sep 09 20:59:29.885997 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.885962 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4263b51a-362c-47f0-a4ef-c83dfb1934fd" path="/var/lib/kubelet/pods/4263b51a-362c-47f0-a4ef-c83dfb1934fd/volumes" Sep 09 20:59:29.886304 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.886291 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5677af11-86c6-425a-9ba2-f4d922ee9f28" path="/var/lib/kubelet/pods/5677af11-86c6-425a-9ba2-f4d922ee9f28/volumes" Sep 09 20:59:29.905440 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.905407 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68789d458d-774d7" event={"ID":"6d90585b-c714-4317-b76d-780a9005d6e6","Type":"ContainerStarted","Data":"127d35fc8e0c84112edf71eaeae033797aa2718ece5e72a24013c6d0dfaff7d1"} Sep 09 20:59:29.905876 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.905446 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68789d458d-774d7" event={"ID":"6d90585b-c714-4317-b76d-780a9005d6e6","Type":"ContainerStarted","Data":"0ee217e7daec69f488e080bd94abd8bad849f0d593f410984269982d4385523b"} Sep 09 20:59:29.984372 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.984315 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68789d458d-774d7" podStartSLOduration=1.573527621 podStartE2EDuration="1.984294382s" totalImagesPullingTime="410.766761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:59:29.930793983 +0000 UTC m=+732.532605553" watchObservedRunningTime="2026-09-09 20:59:29.984294382 +0000 UTC m=+732.586105953" Sep 09 20:59:29.986436 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.986416 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6cd8cd64fd-2vjpx"] Sep 09 20:59:29.986586 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:29.986568 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" podUID="38912dbd-93c1-430b-8ac0-e2432a8c286d" containerName="authorino" containerID="cri-o://65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e" gracePeriod=30 Sep 09 20:59:30.220626 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.220603 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" Sep 09 20:59:30.300370 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.300342 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fnj5\" (UniqueName: \"kubernetes.io/projected/38912dbd-93c1-430b-8ac0-e2432a8c286d-kube-api-access-7fnj5\") pod \"38912dbd-93c1-430b-8ac0-e2432a8c286d\" (UID: \"38912dbd-93c1-430b-8ac0-e2432a8c286d\") " Sep 09 20:59:30.302272 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.302246 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38912dbd-93c1-430b-8ac0-e2432a8c286d-kube-api-access-7fnj5" (OuterVolumeSpecName: "kube-api-access-7fnj5") pod "38912dbd-93c1-430b-8ac0-e2432a8c286d" (UID: "38912dbd-93c1-430b-8ac0-e2432a8c286d"). InnerVolumeSpecName "kube-api-access-7fnj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:59:30.401763 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.401696 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fnj5\" (UniqueName: \"kubernetes.io/projected/38912dbd-93c1-430b-8ac0-e2432a8c286d-kube-api-access-7fnj5\") on node \"ip-10-0-132-118.ec2.internal\" DevicePath \"\"" Sep 09 20:59:30.916184 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.916143 2580 generic.go:356] "Generic (PLEG): container finished" podID="38912dbd-93c1-430b-8ac0-e2432a8c286d" containerID="65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e" exitCode=0 Sep 09 20:59:30.916636 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.916209 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" Sep 09 20:59:30.916636 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.916234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" event={"ID":"38912dbd-93c1-430b-8ac0-e2432a8c286d","Type":"ContainerDied","Data":"65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e"} Sep 09 20:59:30.916636 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.916275 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd8cd64fd-2vjpx" event={"ID":"38912dbd-93c1-430b-8ac0-e2432a8c286d","Type":"ContainerDied","Data":"8a2f65ac4acbb01660f33e09d9da25460b3c1de4a2ab12ec6f26f57938086da7"} Sep 09 20:59:30.916636 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.916295 2580 scope.go:117] "RemoveContainer" containerID="65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e" Sep 09 20:59:30.925050 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.925030 2580 scope.go:117] "RemoveContainer" containerID="65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e" Sep 09 20:59:30.925329 ip-10-0-132-118 kubenswrapper[2580]: E0909 20:59:30.925309 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e\": container with ID starting with 65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e not found: ID does not exist" containerID="65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e" Sep 09 20:59:30.925383 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.925337 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e"} err="failed to get container status \"65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e\": rpc error: code = NotFound desc = could not find container \"65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e\": container with ID starting with 65fc00bd6a8be5dd31d595dd3d5eb587c299480007d6704817645d3ead5d034e not found: ID does not exist" Sep 09 20:59:30.953353 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.953323 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6cd8cd64fd-2vjpx"] Sep 09 20:59:30.961435 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:30.961408 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6cd8cd64fd-2vjpx"] Sep 09 20:59:31.885585 ip-10-0-132-118 kubenswrapper[2580]: I0909 20:59:31.885549 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38912dbd-93c1-430b-8ac0-e2432a8c286d" path="/var/lib/kubelet/pods/38912dbd-93c1-430b-8ac0-e2432a8c286d/volumes" Sep 09 21:00:10.965221 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:10.965188 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d5mdd"] Sep 09 21:00:10.965688 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:10.965505 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38912dbd-93c1-430b-8ac0-e2432a8c286d" containerName="authorino" Sep 09 21:00:10.965688 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:10.965517 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="38912dbd-93c1-430b-8ac0-e2432a8c286d" containerName="authorino" Sep 09 21:00:10.965688 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:10.965579 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="38912dbd-93c1-430b-8ac0-e2432a8c286d" containerName="authorino" Sep 09 21:00:10.967629 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:10.967606 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:10.970337 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:10.970311 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 09 21:00:10.970453 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:10.970312 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4gq6k\"" Sep 09 21:00:10.994296 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:10.994270 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d5mdd"] Sep 09 21:00:11.011169 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:11.011143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkt45\" (UniqueName: \"kubernetes.io/projected/1338c962-0625-4c3e-a9cd-ffe20806c50f-kube-api-access-nkt45\") pod \"payload-processing-5b54b7fbb7-d5mdd\" (UID: \"1338c962-0625-4c3e-a9cd-ffe20806c50f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:11.011268 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:11.011173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1338c962-0625-4c3e-a9cd-ffe20806c50f-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d5mdd\" (UID: \"1338c962-0625-4c3e-a9cd-ffe20806c50f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:11.111597 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:11.111569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkt45\" (UniqueName: \"kubernetes.io/projected/1338c962-0625-4c3e-a9cd-ffe20806c50f-kube-api-access-nkt45\") pod \"payload-processing-5b54b7fbb7-d5mdd\" (UID: \"1338c962-0625-4c3e-a9cd-ffe20806c50f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:11.111740 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:11.111602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1338c962-0625-4c3e-a9cd-ffe20806c50f-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d5mdd\" (UID: \"1338c962-0625-4c3e-a9cd-ffe20806c50f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:11.112358 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:11.112336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1338c962-0625-4c3e-a9cd-ffe20806c50f-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d5mdd\" (UID: \"1338c962-0625-4c3e-a9cd-ffe20806c50f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:11.130062 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:11.130033 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkt45\" (UniqueName: \"kubernetes.io/projected/1338c962-0625-4c3e-a9cd-ffe20806c50f-kube-api-access-nkt45\") pod \"payload-processing-5b54b7fbb7-d5mdd\" (UID: \"1338c962-0625-4c3e-a9cd-ffe20806c50f\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:11.278043 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:11.277949 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:11.565555 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:11.565518 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d5mdd"] Sep 09 21:00:11.567004 ip-10-0-132-118 kubenswrapper[2580]: W0909 21:00:11.566977 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1338c962_0625_4c3e_a9cd_ffe20806c50f.slice/crio-683bd6bd29888e87eeb2f799fe405b32b88c64c0da837444e1968c59a1a629e1 WatchSource:0}: Error finding container 683bd6bd29888e87eeb2f799fe405b32b88c64c0da837444e1968c59a1a629e1: Status 404 returned error can't find the container with id 683bd6bd29888e87eeb2f799fe405b32b88c64c0da837444e1968c59a1a629e1 Sep 09 21:00:12.122319 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:12.122286 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" event={"ID":"1338c962-0625-4c3e-a9cd-ffe20806c50f","Type":"ContainerStarted","Data":"683bd6bd29888e87eeb2f799fe405b32b88c64c0da837444e1968c59a1a629e1"} Sep 09 21:00:14.133859 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:14.133824 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" event={"ID":"1338c962-0625-4c3e-a9cd-ffe20806c50f","Type":"ContainerStarted","Data":"10b6486e8dc6593592e204cec6a233bf840b8ed5f512a1edc7fb45ed044d93b2"} Sep 09 21:00:14.134290 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:14.133884 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:14.165478 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:14.165423 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" podStartSLOduration=2.229658286 podStartE2EDuration="4.165404804s" totalImagesPullingTime="1.935746518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:14.16193836 +0000 UTC m=+776.763749931" watchObservedRunningTime="2026-09-09 21:00:14.165404804 +0000 UTC m=+776.767216377" Sep 09 21:00:25.140307 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:25.140273 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5mdd" Sep 09 21:00:49.905185 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:49.905152 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj"] Sep 09 21:00:49.907420 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:49.907399 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:49.909746 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:49.909721 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gkdq5\"" Sep 09 21:00:49.909882 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:49.909771 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 21:00:49.910694 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:49.910672 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 21:00:49.910809 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:49.910696 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 09 21:00:49.919328 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:49.919307 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj"] Sep 09 21:00:50.027445 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.027414 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.027608 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.027455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36c989f0-f30a-4661-9e43-3eadba8178fe-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.027608 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.027553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.027608 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.027571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.027608 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.027593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.027901 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.027623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klnwc\" (UniqueName: \"kubernetes.io/projected/36c989f0-f30a-4661-9e43-3eadba8178fe-kube-api-access-klnwc\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.128926 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.128902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.129033 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.128929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.129033 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.128945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.129033 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.128975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klnwc\" (UniqueName: \"kubernetes.io/projected/36c989f0-f30a-4661-9e43-3eadba8178fe-kube-api-access-klnwc\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.129033 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.129017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.129178 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.129058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36c989f0-f30a-4661-9e43-3eadba8178fe-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.129389 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.129363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.129509 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.129402 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.129509 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.129455 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.131025 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.131004 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36c989f0-f30a-4661-9e43-3eadba8178fe-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.131337 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.131317 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36c989f0-f30a-4661-9e43-3eadba8178fe-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.138364 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.138343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klnwc\" (UniqueName: \"kubernetes.io/projected/36c989f0-f30a-4661-9e43-3eadba8178fe-kube-api-access-klnwc\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj\" (UID: \"36c989f0-f30a-4661-9e43-3eadba8178fe\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.218570 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.218509 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:00:50.490097 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:50.490069 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj"] Sep 09 21:00:50.491760 ip-10-0-132-118 kubenswrapper[2580]: W0909 21:00:50.491733 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c989f0_f30a_4661_9e43_3eadba8178fe.slice/crio-7215837b8fc13deae8183c9c690d9d2046d3bcc9245ca15fb2e44d5a637f2ee4 WatchSource:0}: Error finding container 7215837b8fc13deae8183c9c690d9d2046d3bcc9245ca15fb2e44d5a637f2ee4: Status 404 returned error can't find the container with id 7215837b8fc13deae8183c9c690d9d2046d3bcc9245ca15fb2e44d5a637f2ee4 Sep 09 21:00:51.332761 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:51.332724 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" event={"ID":"36c989f0-f30a-4661-9e43-3eadba8178fe","Type":"ContainerStarted","Data":"7215837b8fc13deae8183c9c690d9d2046d3bcc9245ca15fb2e44d5a637f2ee4"} Sep 09 21:00:52.339160 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:52.339124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" event={"ID":"36c989f0-f30a-4661-9e43-3eadba8178fe","Type":"ContainerStarted","Data":"9bc3b7194f1ef4c96b25c701b1626edc7763ded102182bf4156a9ad3bcd44c31"} Sep 09 21:00:52.358135 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:00:52.358084 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" podStartSLOduration=2.340109388 podStartE2EDuration="3.358069409s" totalImagesPullingTime="1.017960021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:00:52.357288192 +0000 UTC m=+814.959099764" watchObservedRunningTime="2026-09-09 21:00:52.358069409 +0000 UTC m=+814.959880980" Sep 09 21:01:00.219088 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.219053 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:01:00.219570 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.219113 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:01:00.231668 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.231648 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:01:00.390851 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.390825 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj" Sep 09 21:01:00.703344 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.703310 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt"] Sep 09 21:01:00.705809 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.705791 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.707955 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.707933 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 09 21:01:00.712292 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.712270 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt"] Sep 09 21:01:00.816257 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.816225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.816415 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.816272 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.816415 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.816345 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.816415 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.816384 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.816555 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.816429 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b805701-dad5-4ca4-9d27-b51d0edbb285-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.816555 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.816446 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkvmq\" (UniqueName: \"kubernetes.io/projected/6b805701-dad5-4ca4-9d27-b51d0edbb285-kube-api-access-pkvmq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.916968 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.916932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.916968 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.916972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.917193 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.917016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b805701-dad5-4ca4-9d27-b51d0edbb285-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.917193 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.917033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkvmq\" (UniqueName: \"kubernetes.io/projected/6b805701-dad5-4ca4-9d27-b51d0edbb285-kube-api-access-pkvmq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.917193 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.917056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.917193 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.917102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.917403 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.917380 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.917517 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.917447 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.917586 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.917532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.919486 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.919445 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b805701-dad5-4ca4-9d27-b51d0edbb285-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.919680 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.919661 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b805701-dad5-4ca4-9d27-b51d0edbb285-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:00.924708 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:00.924687 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkvmq\" (UniqueName: \"kubernetes.io/projected/6b805701-dad5-4ca4-9d27-b51d0edbb285-kube-api-access-pkvmq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rhsbt\" (UID: \"6b805701-dad5-4ca4-9d27-b51d0edbb285\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:01.017790 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:01.017721 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:01.291946 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:01.291919 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt"] Sep 09 21:01:01.293749 ip-10-0-132-118 kubenswrapper[2580]: W0909 21:01:01.293722 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b805701_dad5_4ca4_9d27_b51d0edbb285.slice/crio-b3b5565dd2712d461004596d3245942060fc740fe58acee1ef81818895c4d6af WatchSource:0}: Error finding container b3b5565dd2712d461004596d3245942060fc740fe58acee1ef81818895c4d6af: Status 404 returned error can't find the container with id b3b5565dd2712d461004596d3245942060fc740fe58acee1ef81818895c4d6af Sep 09 21:01:01.386494 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:01.386442 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" event={"ID":"6b805701-dad5-4ca4-9d27-b51d0edbb285","Type":"ContainerStarted","Data":"b3b5565dd2712d461004596d3245942060fc740fe58acee1ef81818895c4d6af"} Sep 09 21:01:02.395128 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:02.395087 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" event={"ID":"6b805701-dad5-4ca4-9d27-b51d0edbb285","Type":"ContainerStarted","Data":"0a543e9ac4f40e44f31ab8cadb529d5c828180f799e953a0b3e7f1c332bd6514"} Sep 09 21:01:02.417313 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:02.417259 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" podStartSLOduration=2.231022256 podStartE2EDuration="2.417242146s" totalImagesPullingTime="186.21989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:02.414148973 +0000 UTC m=+825.015960554" watchObservedRunningTime="2026-09-09 21:01:02.417242146 +0000 UTC m=+825.019053717" Sep 09 21:01:10.601655 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.601609 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch"] Sep 09 21:01:10.604098 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.604066 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.606489 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.606442 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 09 21:01:10.615028 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.615008 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch"] Sep 09 21:01:10.704884 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.704848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.704884 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.704888 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.705087 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.704909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.705087 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.704963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49aeedf9-74cc-4643-bfe9-6682189c100a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.705087 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.704987 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thrwg\" (UniqueName: \"kubernetes.io/projected/49aeedf9-74cc-4643-bfe9-6682189c100a-kube-api-access-thrwg\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.705087 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.705026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.805885 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.805848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.806072 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.805893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.806072 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.805913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.806072 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.805943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49aeedf9-74cc-4643-bfe9-6682189c100a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.806072 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.805974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thrwg\" (UniqueName: \"kubernetes.io/projected/49aeedf9-74cc-4643-bfe9-6682189c100a-kube-api-access-thrwg\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.806072 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.806027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.806384 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.806355 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.806384 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.806376 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.806614 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.806486 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.808273 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.808251 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49aeedf9-74cc-4643-bfe9-6682189c100a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.808632 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.808612 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49aeedf9-74cc-4643-bfe9-6682189c100a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.813630 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.813612 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thrwg\" (UniqueName: \"kubernetes.io/projected/49aeedf9-74cc-4643-bfe9-6682189c100a-kube-api-access-thrwg\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch\" (UID: \"49aeedf9-74cc-4643-bfe9-6682189c100a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:10.914893 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:10.914806 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:11.017866 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:11.017831 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:11.018041 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:11.017910 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:11.030312 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:11.030281 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:11.193008 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:11.192968 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch"] Sep 09 21:01:11.194198 ip-10-0-132-118 kubenswrapper[2580]: W0909 21:01:11.194162 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49aeedf9_74cc_4643_bfe9_6682189c100a.slice/crio-b007a59824150f55db60ee8df86eaa2bff40a86188d74e0b3c2a01337abcd18e WatchSource:0}: Error finding container b007a59824150f55db60ee8df86eaa2bff40a86188d74e0b3c2a01337abcd18e: Status 404 returned error can't find the container with id b007a59824150f55db60ee8df86eaa2bff40a86188d74e0b3c2a01337abcd18e Sep 09 21:01:11.442485 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:11.442401 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" event={"ID":"49aeedf9-74cc-4643-bfe9-6682189c100a","Type":"ContainerStarted","Data":"3cd818f37bd874a22e7d90585520b49731aa27ff5fd0375be3fa324c5d43cc43"} Sep 09 21:01:11.442485 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:11.442439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" event={"ID":"49aeedf9-74cc-4643-bfe9-6682189c100a","Type":"ContainerStarted","Data":"b007a59824150f55db60ee8df86eaa2bff40a86188d74e0b3c2a01337abcd18e"} Sep 09 21:01:11.455122 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:11.455095 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rhsbt" Sep 09 21:01:11.461270 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:11.461227 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podStartSLOduration=1.27606114 podStartE2EDuration="1.461208035s" totalImagesPullingTime="185.146895ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:01:11.459061341 +0000 UTC m=+834.060872912" watchObservedRunningTime="2026-09-09 21:01:11.461208035 +0000 UTC m=+834.063019630" Sep 09 21:01:12.449009 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:12.448973 2580 generic.go:356] "Generic (PLEG): container finished" podID="49aeedf9-74cc-4643-bfe9-6682189c100a" containerID="3cd818f37bd874a22e7d90585520b49731aa27ff5fd0375be3fa324c5d43cc43" exitCode=0 Sep 09 21:01:12.449425 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:12.449059 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" event={"ID":"49aeedf9-74cc-4643-bfe9-6682189c100a","Type":"ContainerDied","Data":"3cd818f37bd874a22e7d90585520b49731aa27ff5fd0375be3fa324c5d43cc43"} Sep 09 21:01:12.449425 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:12.449280 2580 scope.go:117] "RemoveContainer" containerID="3cd818f37bd874a22e7d90585520b49731aa27ff5fd0375be3fa324c5d43cc43" Sep 09 21:01:13.456905 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:13.456868 2580 generic.go:356] "Generic (PLEG): container finished" podID="49aeedf9-74cc-4643-bfe9-6682189c100a" containerID="8f874125a677388ccd8ec80ba2cb38625da21a11e64161c639022a5b7df9f585" exitCode=0 Sep 09 21:01:13.457290 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:13.456953 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" event={"ID":"49aeedf9-74cc-4643-bfe9-6682189c100a","Type":"ContainerDied","Data":"8f874125a677388ccd8ec80ba2cb38625da21a11e64161c639022a5b7df9f585"} Sep 09 21:01:13.457290 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:13.457003 2580 scope.go:117] "RemoveContainer" containerID="3cd818f37bd874a22e7d90585520b49731aa27ff5fd0375be3fa324c5d43cc43" Sep 09 21:01:13.457290 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:13.457248 2580 scope.go:117] "RemoveContainer" containerID="8f874125a677388ccd8ec80ba2cb38625da21a11e64161c639022a5b7df9f585" Sep 09 21:01:13.457457 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:01:13.457431 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:01:14.464315 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:14.464285 2580 scope.go:117] "RemoveContainer" containerID="8f874125a677388ccd8ec80ba2cb38625da21a11e64161c639022a5b7df9f585" Sep 09 21:01:14.464710 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:01:14.464501 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:01:20.915227 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:20.915184 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:20.915227 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:20.915237 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:20.915713 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:20.915249 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:20.915713 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:20.915258 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:20.915713 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:20.915629 2580 scope.go:117] "RemoveContainer" containerID="8f874125a677388ccd8ec80ba2cb38625da21a11e64161c639022a5b7df9f585" Sep 09 21:01:20.915819 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:01:20.915786 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:01:31.880672 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:31.880640 2580 scope.go:117] "RemoveContainer" containerID="8f874125a677388ccd8ec80ba2cb38625da21a11e64161c639022a5b7df9f585" Sep 09 21:01:32.558515 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:32.558457 2580 generic.go:356] "Generic (PLEG): container finished" podID="49aeedf9-74cc-4643-bfe9-6682189c100a" containerID="983ab80768f5f5316fb08e88ecc5f82c8ffbf3c258590538147fa7ac356d2ba8" exitCode=0 Sep 09 21:01:32.558687 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:32.558533 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" event={"ID":"49aeedf9-74cc-4643-bfe9-6682189c100a","Type":"ContainerDied","Data":"983ab80768f5f5316fb08e88ecc5f82c8ffbf3c258590538147fa7ac356d2ba8"} Sep 09 21:01:32.558687 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:32.558589 2580 scope.go:117] "RemoveContainer" containerID="8f874125a677388ccd8ec80ba2cb38625da21a11e64161c639022a5b7df9f585" Sep 09 21:01:32.558928 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:32.558900 2580 scope.go:117] "RemoveContainer" containerID="983ab80768f5f5316fb08e88ecc5f82c8ffbf3c258590538147fa7ac356d2ba8" Sep 09 21:01:32.559126 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:01:32.559096 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:01:40.915588 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:40.915546 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:40.915978 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:40.915604 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:40.915978 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:40.915651 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:40.915978 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:40.915704 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:01:40.916086 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:40.916001 2580 scope.go:117] "RemoveContainer" containerID="983ab80768f5f5316fb08e88ecc5f82c8ffbf3c258590538147fa7ac356d2ba8" Sep 09 21:01:40.916264 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:01:40.916241 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:01:41.606559 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:41.606532 2580 scope.go:117] "RemoveContainer" containerID="983ab80768f5f5316fb08e88ecc5f82c8ffbf3c258590538147fa7ac356d2ba8" Sep 09 21:01:41.606721 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:01:41.606700 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:01:54.880733 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:54.880704 2580 scope.go:117] "RemoveContainer" containerID="983ab80768f5f5316fb08e88ecc5f82c8ffbf3c258590538147fa7ac356d2ba8" Sep 09 21:01:55.680630 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:55.680598 2580 generic.go:356] "Generic (PLEG): container finished" podID="49aeedf9-74cc-4643-bfe9-6682189c100a" containerID="0700c20818a8a991cd773c5cb9db0b28a113f95baee7fbce607ecfd01d94456f" exitCode=0 Sep 09 21:01:55.680799 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:55.680641 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" event={"ID":"49aeedf9-74cc-4643-bfe9-6682189c100a","Type":"ContainerDied","Data":"0700c20818a8a991cd773c5cb9db0b28a113f95baee7fbce607ecfd01d94456f"} Sep 09 21:01:55.680799 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:55.680677 2580 scope.go:117] "RemoveContainer" containerID="983ab80768f5f5316fb08e88ecc5f82c8ffbf3c258590538147fa7ac356d2ba8" Sep 09 21:01:55.680979 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:01:55.680960 2580 scope.go:117] "RemoveContainer" containerID="0700c20818a8a991cd773c5cb9db0b28a113f95baee7fbce607ecfd01d94456f" Sep 09 21:01:55.681180 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:01:55.681158 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:02:00.915132 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:00.915081 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:02:00.915132 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:00.915144 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:02:00.915617 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:00.915157 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:02:00.915617 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:00.915169 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:02:00.915617 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:00.915556 2580 scope.go:117] "RemoveContainer" containerID="0700c20818a8a991cd773c5cb9db0b28a113f95baee7fbce607ecfd01d94456f" Sep 09 21:02:00.915756 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:02:00.915733 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:02:12.880529 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:12.880438 2580 scope.go:117] "RemoveContainer" containerID="0700c20818a8a991cd773c5cb9db0b28a113f95baee7fbce607ecfd01d94456f" Sep 09 21:02:12.880881 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:02:12.880643 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:02:26.880741 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:26.880699 2580 scope.go:117] "RemoveContainer" containerID="0700c20818a8a991cd773c5cb9db0b28a113f95baee7fbce607ecfd01d94456f" Sep 09 21:02:26.883127 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:02:26.880886 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:02:41.880870 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:41.880837 2580 scope.go:117] "RemoveContainer" containerID="0700c20818a8a991cd773c5cb9db0b28a113f95baee7fbce607ecfd01d94456f" Sep 09 21:02:42.928559 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:42.928519 2580 generic.go:356] "Generic (PLEG): container finished" podID="49aeedf9-74cc-4643-bfe9-6682189c100a" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" exitCode=0 Sep 09 21:02:42.928955 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:42.928565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" event={"ID":"49aeedf9-74cc-4643-bfe9-6682189c100a","Type":"ContainerDied","Data":"770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7"} Sep 09 21:02:42.928955 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:42.928600 2580 scope.go:117] "RemoveContainer" containerID="0700c20818a8a991cd773c5cb9db0b28a113f95baee7fbce607ecfd01d94456f" Sep 09 21:02:42.928955 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:42.928904 2580 scope.go:117] "RemoveContainer" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" Sep 09 21:02:42.929089 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:02:42.929063 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:02:50.915790 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:50.915761 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:02:50.915790 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:50.915796 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:02:50.916273 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:50.915806 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:02:50.916273 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:50.915818 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:02:50.916273 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:02:50.916083 2580 scope.go:117] "RemoveContainer" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" Sep 09 21:02:50.916273 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:02:50.916224 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:03:02.880229 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:03:02.880191 2580 scope.go:117] "RemoveContainer" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" Sep 09 21:03:02.880677 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:03:02.880353 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:03:16.880932 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:03:16.880895 2580 scope.go:117] "RemoveContainer" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" Sep 09 21:03:16.881397 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:03:16.881096 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:03:27.883104 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:03:27.883071 2580 scope.go:117] "RemoveContainer" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" Sep 09 21:03:27.883603 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:03:27.883253 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:03:39.880346 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:03:39.880309 2580 scope.go:117] "RemoveContainer" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" Sep 09 21:03:39.880750 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:03:39.880527 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:03:50.880269 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:03:50.880239 2580 scope.go:117] "RemoveContainer" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" Sep 09 21:03:50.880664 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:03:50.880395 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:04:02.880857 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:02.880819 2580 scope.go:117] "RemoveContainer" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" Sep 09 21:04:02.881320 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:02.881106 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 21:04:03.336544 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:03.336508 2580 generic.go:356] "Generic (PLEG): container finished" podID="49aeedf9-74cc-4643-bfe9-6682189c100a" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" exitCode=0 Sep 09 21:04:03.336719 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:03.336577 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" event={"ID":"49aeedf9-74cc-4643-bfe9-6682189c100a","Type":"ContainerDied","Data":"5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4"} Sep 09 21:04:03.336719 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:03.336630 2580 scope.go:117] "RemoveContainer" containerID="770f08ef1c2fe235415a556543f037b89aece51ff3cd90e04f8de790a5bd5bf7" Sep 09 21:04:03.336979 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:03.336961 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:04:03.337161 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:04:03.337141 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:04:10.915622 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:10.915584 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:04:10.916070 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:10.915633 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:04:10.916070 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:10.915646 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:04:10.916070 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:10.915655 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" Sep 09 21:04:10.916070 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:10.915934 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:04:10.916252 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:04:10.916077 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:04:24.880638 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:24.880608 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:04:24.881026 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:04:24.880779 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:04:36.880406 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:36.880366 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:04:36.880951 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:04:36.880566 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:04:48.880600 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:04:48.880570 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:04:48.880989 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:04:48.880733 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:05:01.886272 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:01.886243 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:05:01.886675 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:05:01.886406 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:05:12.880380 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:12.880306 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:05:12.880840 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:05:12.880482 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:05:24.880523 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:24.880493 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:05:24.880903 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:05:24.880677 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:05:27.786505 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:27.786476 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68789d458d-774d7_6d90585b-c714-4317-b76d-780a9005d6e6/authorino/0.log" Sep 09 21:05:34.583709 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:34.583679 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf5684c-8zdvh_178f361f-9172-40dd-b502-b84d32eea8ae/copy-manifests/0.log" Sep 09 21:05:34.595541 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:34.595516 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf5684c-8zdvh_178f361f-9172-40dd-b502-b84d32eea8ae/manager/0.log" Sep 09 21:05:35.995091 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:35.995055 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68789d458d-774d7_6d90585b-c714-4317-b76d-780a9005d6e6/authorino/0.log" Sep 09 21:05:36.375189 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:36.375160 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-zfsqx_c8e9c895-a29f-46c0-bf66-536bd890e4ca/kuadrant-console-plugin/0.log" Sep 09 21:05:36.880366 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:36.880336 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:05:36.880566 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:05:36.880546 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:05:37.337397 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:37.337363 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c789b6945-tbzdn_168ded2e-3923-4cca-b146-88c9ca180cf6/kube-auth-proxy/0.log" Sep 09 21:05:37.785960 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:37.785867 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5mdd_1338c962-0625-4c3e-a9cd-ffe20806c50f/payload-processing/0.log" Sep 09 21:05:38.471759 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:38.471730 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-zlzhj_36c989f0-f30a-4661-9e43-3eadba8178fe/main/0.log" Sep 09 21:05:38.587481 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:38.587439 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rhsbt_6b805701-dad5-4ca4-9d27-b51d0edbb285/main/0.log" Sep 09 21:05:38.957993 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:38.957964 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_49aeedf9-74cc-4643-bfe9-6682189c100a/main/5.log" Sep 09 21:05:44.772218 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.772186 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qh5hz/must-gather-bwfqf"] Sep 09 21:05:44.776219 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.776196 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh5hz/must-gather-bwfqf" Sep 09 21:05:44.780257 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.780238 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh5hz\"/\"kube-root-ca.crt\"" Sep 09 21:05:44.780908 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.780890 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh5hz\"/\"openshift-service-ca.crt\"" Sep 09 21:05:44.781013 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.780896 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qh5hz\"/\"default-dockercfg-k6l4r\"" Sep 09 21:05:44.788297 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.788271 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh5hz/must-gather-bwfqf"] Sep 09 21:05:44.860319 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.860286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6bd62166-8418-4cf1-9a0d-0afc9d3ea055-must-gather-output\") pod \"must-gather-bwfqf\" (UID: \"6bd62166-8418-4cf1-9a0d-0afc9d3ea055\") " pod="openshift-must-gather-qh5hz/must-gather-bwfqf" Sep 09 21:05:44.860319 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.860315 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggqq2\" (UniqueName: \"kubernetes.io/projected/6bd62166-8418-4cf1-9a0d-0afc9d3ea055-kube-api-access-ggqq2\") pod \"must-gather-bwfqf\" (UID: \"6bd62166-8418-4cf1-9a0d-0afc9d3ea055\") " pod="openshift-must-gather-qh5hz/must-gather-bwfqf" Sep 09 21:05:44.960906 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.960866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6bd62166-8418-4cf1-9a0d-0afc9d3ea055-must-gather-output\") pod \"must-gather-bwfqf\" (UID: \"6bd62166-8418-4cf1-9a0d-0afc9d3ea055\") " pod="openshift-must-gather-qh5hz/must-gather-bwfqf" Sep 09 21:05:44.960906 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.960904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqq2\" (UniqueName: \"kubernetes.io/projected/6bd62166-8418-4cf1-9a0d-0afc9d3ea055-kube-api-access-ggqq2\") pod \"must-gather-bwfqf\" (UID: \"6bd62166-8418-4cf1-9a0d-0afc9d3ea055\") " pod="openshift-must-gather-qh5hz/must-gather-bwfqf" Sep 09 21:05:44.961282 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.961258 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6bd62166-8418-4cf1-9a0d-0afc9d3ea055-must-gather-output\") pod \"must-gather-bwfqf\" (UID: \"6bd62166-8418-4cf1-9a0d-0afc9d3ea055\") " pod="openshift-must-gather-qh5hz/must-gather-bwfqf" Sep 09 21:05:44.969394 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:44.969370 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggqq2\" (UniqueName: \"kubernetes.io/projected/6bd62166-8418-4cf1-9a0d-0afc9d3ea055-kube-api-access-ggqq2\") pod \"must-gather-bwfqf\" (UID: \"6bd62166-8418-4cf1-9a0d-0afc9d3ea055\") " pod="openshift-must-gather-qh5hz/must-gather-bwfqf" Sep 09 21:05:45.085272 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:45.085228 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh5hz/must-gather-bwfqf" Sep 09 21:05:45.375505 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:45.375471 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh5hz/must-gather-bwfqf"] Sep 09 21:05:45.377075 ip-10-0-132-118 kubenswrapper[2580]: W0909 21:05:45.377049 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bd62166_8418_4cf1_9a0d_0afc9d3ea055.slice/crio-6234c1690baab7ee2d52a635a75efa7c54a8296f2d7a369cf105aa3160ee94a7 WatchSource:0}: Error finding container 6234c1690baab7ee2d52a635a75efa7c54a8296f2d7a369cf105aa3160ee94a7: Status 404 returned error can't find the container with id 6234c1690baab7ee2d52a635a75efa7c54a8296f2d7a369cf105aa3160ee94a7 Sep 09 21:05:45.869795 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:45.869754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh5hz/must-gather-bwfqf" event={"ID":"6bd62166-8418-4cf1-9a0d-0afc9d3ea055","Type":"ContainerStarted","Data":"6234c1690baab7ee2d52a635a75efa7c54a8296f2d7a369cf105aa3160ee94a7"} Sep 09 21:05:46.878604 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:46.878561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh5hz/must-gather-bwfqf" event={"ID":"6bd62166-8418-4cf1-9a0d-0afc9d3ea055","Type":"ContainerStarted","Data":"3f6d600edbc7377845c426acd8875b1467652af42c06bf275a345d81b6957909"} Sep 09 21:05:46.879080 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:46.878619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh5hz/must-gather-bwfqf" event={"ID":"6bd62166-8418-4cf1-9a0d-0afc9d3ea055","Type":"ContainerStarted","Data":"ce445bdeaac33115117c60b3614b767321037b775e1dce6f0fad4a80ed8db18b"} Sep 09 21:05:46.900810 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:46.900742 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qh5hz/must-gather-bwfqf" podStartSLOduration=2.029746475 podStartE2EDuration="2.900718859s" totalImagesPullingTime="870.972384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:05:46.896939355 +0000 UTC m=+1109.498750927" watchObservedRunningTime="2026-09-09 21:05:46.900718859 +0000 UTC m=+1109.502530431" Sep 09 21:05:47.924399 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:47.924371 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gfmr9_016e1f64-8347-482f-ba28-c31904328c16/global-pull-secret-syncer/0.log" Sep 09 21:05:48.086368 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:48.086335 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-krxz8_4bc0c4d7-5ee3-4d69-9a3e-5ec6fb4be021/konnectivity-agent/0.log" Sep 09 21:05:48.111211 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:48.111178 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-118.ec2.internal_942be75416b9572b238c9a5fb039e0c8/haproxy/0.log" Sep 09 21:05:48.881004 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:48.880974 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:05:48.881235 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:05:48.881210 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:05:53.121359 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:53.121326 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68789d458d-774d7_6d90585b-c714-4317-b76d-780a9005d6e6/authorino/0.log" Sep 09 21:05:53.224074 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:53.224045 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-zfsqx_c8e9c895-a29f-46c0-bf66-536bd890e4ca/kuadrant-console-plugin/0.log" Sep 09 21:05:54.668061 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:54.668026 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b87c1ac0-a09a-482b-ba98-83af8d17cdbf/alertmanager/0.log" Sep 09 21:05:54.691445 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:54.691414 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b87c1ac0-a09a-482b-ba98-83af8d17cdbf/config-reloader/0.log" Sep 09 21:05:54.716821 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:54.716794 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b87c1ac0-a09a-482b-ba98-83af8d17cdbf/kube-rbac-proxy-web/0.log" Sep 09 21:05:54.743375 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:54.743351 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b87c1ac0-a09a-482b-ba98-83af8d17cdbf/kube-rbac-proxy/0.log" Sep 09 21:05:54.771024 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:54.770992 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b87c1ac0-a09a-482b-ba98-83af8d17cdbf/kube-rbac-proxy-metric/0.log" Sep 09 21:05:54.799210 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:54.799189 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b87c1ac0-a09a-482b-ba98-83af8d17cdbf/prom-label-proxy/0.log" Sep 09 21:05:54.821230 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:54.821208 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b87c1ac0-a09a-482b-ba98-83af8d17cdbf/init-config-reloader/0.log" Sep 09 21:05:55.261833 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:55.261758 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mlm4r_680768b6-404c-4858-a243-0ecab888c5d3/node-exporter/0.log" Sep 09 21:05:55.285026 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:55.284994 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mlm4r_680768b6-404c-4858-a243-0ecab888c5d3/kube-rbac-proxy/0.log" Sep 09 21:05:55.308472 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:55.308433 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mlm4r_680768b6-404c-4858-a243-0ecab888c5d3/init-textfile/0.log" Sep 09 21:05:55.339521 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:55.339495 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-pnvqj_214979d4-f25c-4443-870a-e19e549756ad/kube-rbac-proxy-main/0.log" Sep 09 21:05:55.363779 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:55.363752 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-pnvqj_214979d4-f25c-4443-870a-e19e549756ad/kube-rbac-proxy-self/0.log" Sep 09 21:05:55.389438 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:55.389402 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-pnvqj_214979d4-f25c-4443-870a-e19e549756ad/openshift-state-metrics/0.log" Sep 09 21:05:55.805153 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:55.805121 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-xmtlm_8a5668d2-7fcc-4a35-bb92-c39172e61535/prometheus-operator-admission-webhook/0.log" Sep 09 21:05:57.524794 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.524752 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl"] Sep 09 21:05:57.530889 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.530719 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.557729 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.546915 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl"] Sep 09 21:05:57.592483 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.591720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-lib-modules\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.592483 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.591780 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-sys\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.592483 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.591850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-proc\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.592483 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.591919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hbhx\" (UniqueName: \"kubernetes.io/projected/d029a7ab-8b91-4515-b5cc-f9cf7e601561-kube-api-access-5hbhx\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.592483 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.591964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-podres\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.692540 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.692495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hbhx\" (UniqueName: \"kubernetes.io/projected/d029a7ab-8b91-4515-b5cc-f9cf7e601561-kube-api-access-5hbhx\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.692718 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.692557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-podres\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.692718 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.692602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-lib-modules\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.692718 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.692639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-sys\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.692718 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.692712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-proc\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.692913 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.692747 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-podres\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.692913 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.692766 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-lib-modules\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.692913 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.692792 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-proc\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.692913 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.692822 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d029a7ab-8b91-4515-b5cc-f9cf7e601561-sys\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.703186 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.703158 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hbhx\" (UniqueName: \"kubernetes.io/projected/d029a7ab-8b91-4515-b5cc-f9cf7e601561-kube-api-access-5hbhx\") pod \"perf-node-gather-daemonset-bzbbl\" (UID: \"d029a7ab-8b91-4515-b5cc-f9cf7e601561\") " pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:57.865693 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:57.865661 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:58.178747 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:58.178665 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl"] Sep 09 21:05:58.182183 ip-10-0-132-118 kubenswrapper[2580]: W0909 21:05:58.182148 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd029a7ab_8b91_4515_b5cc_f9cf7e601561.slice/crio-2726d624382183aac32015b9740c6b03d35a080a93e4411300791b8926602d04 WatchSource:0}: Error finding container 2726d624382183aac32015b9740c6b03d35a080a93e4411300791b8926602d04: Status 404 returned error can't find the container with id 2726d624382183aac32015b9740c6b03d35a080a93e4411300791b8926602d04 Sep 09 21:05:58.395485 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:58.395441 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dc9885ff6-4fpgn_20a4b751-1b22-4004-928e-c909df4d72da/console/0.log" Sep 09 21:05:58.434953 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:58.434882 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-6g2z2_a38c71bb-2f39-43f9-90f4-2a1444f6e9a9/download-server/0.log" Sep 09 21:05:58.974413 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:58.974376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" event={"ID":"d029a7ab-8b91-4515-b5cc-f9cf7e601561","Type":"ContainerStarted","Data":"c17d62864636671dd95ef97ea94cb6a996668c29bb15d38f7f86d53ec1411bc4"} Sep 09 21:05:58.974882 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:58.974451 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" event={"ID":"d029a7ab-8b91-4515-b5cc-f9cf7e601561","Type":"ContainerStarted","Data":"2726d624382183aac32015b9740c6b03d35a080a93e4411300791b8926602d04"} Sep 09 21:05:58.974882 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:58.974505 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:05:59.005495 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:59.005421 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" podStartSLOduration=2.005348146 podStartE2EDuration="2.005348146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:05:59.001190358 +0000 UTC m=+1121.603001934" watchObservedRunningTime="2026-09-09 21:05:59.005348146 +0000 UTC m=+1121.607159717" Sep 09 21:05:59.880342 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:05:59.880302 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:05:59.880563 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:05:59.880502 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:06:00.224126 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:00.224049 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-phb64_fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b/dns/0.log" Sep 09 21:06:00.245678 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:00.245658 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-phb64_fa718c5e-e3f5-4a17-95c2-a01eb79c7f1b/kube-rbac-proxy/0.log" Sep 09 21:06:00.295077 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:00.295049 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w5g8k_4b2715ed-3169-453c-9ddb-3f9b9a31472d/dns-node-resolver/0.log" Sep 09 21:06:00.877933 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:00.877900 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5kpxb_0a385051-1f26-4c84-959c-7a561354e285/node-ca/0.log" Sep 09 21:06:01.942229 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:01.942197 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c789b6945-tbzdn_168ded2e-3923-4cca-b146-88c9ca180cf6/kube-auth-proxy/0.log" Sep 09 21:06:02.055167 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:02.055136 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5mdd_1338c962-0625-4c3e-a9cd-ffe20806c50f/payload-processing/0.log" Sep 09 21:06:02.793930 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:02.793905 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jfvbb_03eae9a8-d21c-458c-94ee-d40ba126492d/serve-healthcheck-canary/0.log" Sep 09 21:06:03.430085 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:03.430058 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s5v5_8927115b-a57a-4aaa-acab-10b966ca1fd6/kube-rbac-proxy/0.log" Sep 09 21:06:03.451476 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:03.451446 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s5v5_8927115b-a57a-4aaa-acab-10b966ca1fd6/exporter/0.log" Sep 09 21:06:03.474384 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:03.474354 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4s5v5_8927115b-a57a-4aaa-acab-10b966ca1fd6/extractor/0.log" Sep 09 21:06:04.990718 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:04.990683 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qh5hz/perf-node-gather-daemonset-bzbbl" Sep 09 21:06:05.968835 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:05.968793 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf5684c-8zdvh_178f361f-9172-40dd-b502-b84d32eea8ae/manager/0.log" Sep 09 21:06:05.987813 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:05.987775 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-97cf5684c-8zdvh_178f361f-9172-40dd-b502-b84d32eea8ae/copy-manifests/0.log" Sep 09 21:06:07.414167 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:07.414074 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7596c9fb79-2bdf2_527285d4-0d45-427f-94ce-c3012c997f06/manager/0.log" Sep 09 21:06:07.473428 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:07.473374 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nrgwz_998e5808-31c6-4802-bc7e-e0b2c72922d4/openshift-lws-operator/0.log" Sep 09 21:06:08.337732 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:08.337703 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c789b6945-tbzdn_168ded2e-3923-4cca-b146-88c9ca180cf6/kube-auth-proxy/0.log" Sep 09 21:06:08.431579 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:08.431547 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5mdd_1338c962-0625-4c3e-a9cd-ffe20806c50f/payload-processing/0.log" Sep 09 21:06:09.637147 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:09.637119 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c789b6945-tbzdn_168ded2e-3923-4cca-b146-88c9ca180cf6/kube-auth-proxy/0.log" Sep 09 21:06:09.709939 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:09.709860 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5mdd_1338c962-0625-4c3e-a9cd-ffe20806c50f/payload-processing/0.log" Sep 09 21:06:11.880271 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:11.880237 2580 scope.go:117] "RemoveContainer" containerID="5b7dde0ff992ac30ba07492c10c2a5b8fbcb39934ba6c0f67caf222f02c2c7d4" Sep 09 21:06:11.880686 ip-10-0-132-118 kubenswrapper[2580]: E0909 21:06:11.880427 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch_llm(49aeedf9-74cc-4643-bfe9-6682189c100a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-sn9ch" podUID="49aeedf9-74cc-4643-bfe9-6682189c100a" Sep 09 21:06:14.115673 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.115641 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9hbd_2e34bfd3-5f54-48e6-9be4-03ebabce312f/kube-multus-additional-cni-plugins/0.log" Sep 09 21:06:14.168313 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.168280 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9hbd_2e34bfd3-5f54-48e6-9be4-03ebabce312f/egress-router-binary-copy/0.log" Sep 09 21:06:14.216596 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.216562 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9hbd_2e34bfd3-5f54-48e6-9be4-03ebabce312f/cni-plugins/0.log" Sep 09 21:06:14.259406 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.259379 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9hbd_2e34bfd3-5f54-48e6-9be4-03ebabce312f/bond-cni-plugin/0.log" Sep 09 21:06:14.300419 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.300364 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9hbd_2e34bfd3-5f54-48e6-9be4-03ebabce312f/routeoverride-cni/0.log" Sep 09 21:06:14.338711 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.338685 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9hbd_2e34bfd3-5f54-48e6-9be4-03ebabce312f/whereabouts-cni-bincopy/0.log" Sep 09 21:06:14.374718 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.374631 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9hbd_2e34bfd3-5f54-48e6-9be4-03ebabce312f/whereabouts-cni/0.log" Sep 09 21:06:14.607533 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.607499 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c7lmx_2d1561c7-7538-4e2f-906e-33004504e1bd/kube-multus/0.log" Sep 09 21:06:14.780533 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.780449 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9k7qt_baaab02f-8a89-400e-a327-f5d48b6907b5/network-metrics-daemon/0.log" Sep 09 21:06:14.801827 ip-10-0-132-118 kubenswrapper[2580]: I0909 21:06:14.801799 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9k7qt_baaab02f-8a89-400e-a327-f5d48b6907b5/kube-rbac-proxy/0.log"